2023-02-12 00:02:51,002 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-12 00:02:51,045 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=167, AvailableMemoryMB=10870 2023-02-12 00:02:51,314 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a 2023-02-12 00:02:51,322 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:02:51,322 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b, deleteOnExit=true 2023-02-12 00:02:51,322 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:02:51,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/test.cache.data in system properties and HBase conf 2023-02-12 00:02:51,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:02:51,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:02:51,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:02:51,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:02:51,324 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:02:51,441 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 00:02:51,893 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:02:51,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:02:51,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:02:51,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:02:51,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:02:51,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:02:51,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:02:51,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:02:51,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:02:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:02:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:02:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:02:51,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:02:51,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:02:51,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:02:52,466 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:02:52,473 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:02:52,839 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 00:02:53,039 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 00:02:53,055 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:02:53,097 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:02:53,135 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/java.io.tmpdir/Jetty_localhost_35691_hdfs____.zb4ht6/webapp 2023-02-12 00:02:53,299 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35691 2023-02-12 00:02:53,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:02:53,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:02:53,853 WARN [Listener at localhost/43363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:02:53,927 WARN [Listener at localhost/43363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:02:53,948 WARN [Listener at localhost/43363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:02:53,955 INFO [Listener at localhost/43363] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:02:53,962 INFO [Listener at localhost/43363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/java.io.tmpdir/Jetty_localhost_42165_datanode____hsdk61/webapp 2023-02-12 00:02:54,119 INFO [Listener at localhost/43363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42165 2023-02-12 00:02:54,571 WARN [Listener at localhost/34033] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:02:54,605 WARN [Listener at localhost/34033] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:02:54,611 WARN [Listener at localhost/34033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:02:54,613 INFO [Listener at localhost/34033] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:02:54,627 INFO [Listener at localhost/34033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/java.io.tmpdir/Jetty_localhost_45505_datanode____ahf0g/webapp 2023-02-12 00:02:54,769 INFO [Listener at localhost/34033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45505 2023-02-12 00:02:54,791 WARN [Listener at localhost/46331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:02:55,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe706db94cfdcba47: Processing first storage report for DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc from datanode 3c6fcada-66a7-45f9-b2da-be6c7ad64d70 2023-02-12 00:02:55,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe706db94cfdcba47: from storage DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=3c6fcada-66a7-45f9-b2da-be6c7ad64d70, infoPort=33705, infoSecurePort=0, ipcPort=46331, storageInfo=lv=-57;cid=testClusterID;nsid=977343116;c=1676160172561), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-12 00:02:55,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2876a2a9cf43437: Processing first storage report for DS-ed4535ba-1f82-4389-913d-9967f2f91021 from datanode ae640952-ae64-493d-adc1-e156ab96f412 2023-02-12 00:02:55,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2876a2a9cf43437: from storage DS-ed4535ba-1f82-4389-913d-9967f2f91021 node DatanodeRegistration(127.0.0.1:36061, datanodeUuid=ae640952-ae64-493d-adc1-e156ab96f412, infoPort=43035, infoSecurePort=0, ipcPort=34033, storageInfo=lv=-57;cid=testClusterID;nsid=977343116;c=1676160172561), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 00:02:55,123 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe706db94cfdcba47: Processing first storage report for DS-996bd994-40ae-4a9c-b0fd-84727bca46cf from datanode 3c6fcada-66a7-45f9-b2da-be6c7ad64d70 2023-02-12 00:02:55,123 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe706db94cfdcba47: from storage DS-996bd994-40ae-4a9c-b0fd-84727bca46cf node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=3c6fcada-66a7-45f9-b2da-be6c7ad64d70, infoPort=33705, infoSecurePort=0, ipcPort=46331, storageInfo=lv=-57;cid=testClusterID;nsid=977343116;c=1676160172561), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:02:55,123 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2876a2a9cf43437: Processing first storage report for DS-e1aecc58-48c7-4f09-920c-f5871a4a37c8 from datanode ae640952-ae64-493d-adc1-e156ab96f412 2023-02-12 00:02:55,123 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2876a2a9cf43437: from storage DS-e1aecc58-48c7-4f09-920c-f5871a4a37c8 node DatanodeRegistration(127.0.0.1:36061, datanodeUuid=ae640952-ae64-493d-adc1-e156ab96f412, infoPort=43035, infoSecurePort=0, ipcPort=34033, storageInfo=lv=-57;cid=testClusterID;nsid=977343116;c=1676160172561), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:02:55,279 DEBUG [Listener at localhost/46331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a 2023-02-12 00:02:55,378 INFO [Listener at localhost/46331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/zookeeper_0, clientPort=61225, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:02:55,397 INFO [Listener at localhost/46331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61225 2023-02-12 00:02:55,405 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:55,407 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:56,117 INFO [Listener at localhost/46331] util.FSUtils(479): Created version file at hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526 with version=8 2023-02-12 00:02:56,118 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:56,119 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:56,122 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/hbase-staging 2023-02-12 00:02:56,439 INFO [Listener at localhost/46331] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 00:02:56,895 INFO [Listener at localhost/46331] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:02:56,927 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:56,928 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:56,928 INFO [Listener at localhost/46331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:02:56,928 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:56,929 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:02:57,072 INFO [Listener at localhost/46331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:02:57,149 DEBUG [Listener at localhost/46331] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 00:02:57,242 INFO [Listener at localhost/46331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:32789 2023-02-12 00:02:57,252 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,255 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,278 INFO [Listener at localhost/46331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32789 connecting to ZooKeeper ensemble=127.0.0.1:61225 2023-02-12 00:02:57,331 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:327890x0, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:02:57,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32789-0x10045d76ced0000 connected 2023-02-12 00:02:57,368 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:02:57,369 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:02:57,373 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:02:57,381 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32789 2023-02-12 00:02:57,381 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32789 2023-02-12 00:02:57,382 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32789 2023-02-12 00:02:57,382 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32789 2023-02-12 00:02:57,382 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32789 2023-02-12 00:02:57,390 INFO [Listener at localhost/46331] master.HMaster(439): hbase.rootdir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526, hbase.cluster.distributed=false 2023-02-12 00:02:57,466 INFO [Listener at localhost/46331] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:02:57,466 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,466 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,467 INFO [Listener at localhost/46331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:02:57,467 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,467 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:02:57,472 INFO [Listener at localhost/46331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:02:57,475 INFO [Listener at localhost/46331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44663 2023-02-12 00:02:57,478 INFO [Listener at localhost/46331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:02:57,485 DEBUG [Listener at localhost/46331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:02:57,486 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,489 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,491 INFO [Listener at localhost/46331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44663 connecting to ZooKeeper ensemble=127.0.0.1:61225 2023-02-12 00:02:57,499 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:446630x0, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:02:57,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44663-0x10045d76ced0001 connected 2023-02-12 00:02:57,500 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:02:57,501 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:02:57,502 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:02:57,502 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 00:02:57,503 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44663 2023-02-12 00:02:57,507 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44663 2023-02-12 00:02:57,507 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 00:02:57,507 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 00:02:57,520 INFO [Listener at localhost/46331] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:02:57,520 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,520 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,520 INFO [Listener at localhost/46331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:02:57,521 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:02:57,521 INFO [Listener at localhost/46331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:02:57,521 INFO [Listener at localhost/46331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:02:57,522 INFO [Listener at localhost/46331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40797 2023-02-12 00:02:57,523 INFO [Listener at localhost/46331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:02:57,526 DEBUG [Listener at localhost/46331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:02:57,527 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,530 INFO [Listener at localhost/46331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,533 INFO [Listener at localhost/46331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40797 connecting to ZooKeeper ensemble=127.0.0.1:61225 2023-02-12 00:02:57,537 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:407970x0, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:02:57,537 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:407970x0, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:02:57,538 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:407970x0, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:02:57,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40797-0x10045d76ced0002 connected 2023-02-12 00:02:57,539 DEBUG [Listener at localhost/46331] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:02:57,540 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40797 2023-02-12 00:02:57,540 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40797 2023-02-12 00:02:57,541 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40797 2023-02-12 00:02:57,542 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40797 2023-02-12 00:02:57,542 DEBUG [Listener at localhost/46331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40797 2023-02-12 00:02:57,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:57,553 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:02:57,554 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:57,572 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:02:57,572 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:02:57,572 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:02:57,573 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:57,573 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:02:57,575 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,32789,1676160176275 from backup master directory 2023-02-12 00:02:57,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:02:57,580 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:57,580 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:02:57,581 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:02:57,581 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:57,584 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 00:02:57,586 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 00:02:57,684 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/hbase.id with ID: 713db996-2dec-40b6-8d8d-d0c99ed0ec24 2023-02-12 00:02:57,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:02:57,749 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:57,806 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7974f79a to 127.0.0.1:61225 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:02:57,841 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65a277c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:02:57,865 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:02:57,867 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:02:57,886 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 00:02:57,886 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 00:02:57,888 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 00:02:57,893 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 00:02:57,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:02:57,929 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store-tmp 2023-02-12 00:02:57,960 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:02:57,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:02:57,961 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:02:57,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:02:57,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:02:57,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:02:57,961 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:02:57,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160177960Disabling compacts and flushes for region at 1676160177961 (+1 ms)Disabling writes for close at 1676160177961Writing region close event to WAL at 1676160177961Closed at 1676160177961 2023-02-12 00:02:57,963 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/WALs/jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:57,984 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C32789%2C1676160176275, suffix=, logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/WALs/jenkins-hbase9.apache.org,32789,1676160176275, archiveDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/oldWALs, maxLogs=10 2023-02-12 00:02:58,048 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK] 2023-02-12 00:02:58,048 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK] 2023-02-12 00:02:58,057 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 00:02:58,118 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/WALs/jenkins-hbase9.apache.org,32789,1676160176275/jenkins-hbase9.apache.org%2C32789%2C1676160176275.1676160177995 2023-02-12 00:02:58,119 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK]] 2023-02-12 00:02:58,119 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:02:58,120 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:02:58,123 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,124 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,186 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,193 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:02:58,225 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:02:58,237 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:58,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,243 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,258 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:02:58,262 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:02:58,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64219756, jitterRate=-0.043051064014434814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:02:58,264 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160178154Initializing all the Stores at 1676160178157 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160178157Cleaning up temporary data from old regions at 1676160178249 (+92 ms)Cleaning up detritus from prior splits at 1676160178249Region opened successfully at 1676160178264 (+15 ms) 2023-02-12 00:02:58,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:02:58,288 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:02:58,288 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:02:58,290 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:02:58,292 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 00:02:58,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-12 00:02:58,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:02:58,357 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:02:58,362 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:02:58,388 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:02:58,393 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:02:58,395 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:02:58,400 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:02:58,404 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:02:58,407 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:58,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:02:58,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:02:58,422 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:02:58,428 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:02:58,428 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:02:58,428 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:02:58,428 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:58,429 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,32789,1676160176275, sessionid=0x10045d76ced0000, setting cluster-up flag (Was=false) 2023-02-12 00:02:58,445 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:58,454 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:02:58,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:58,461 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:58,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:02:58,467 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:02:58,470 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/.tmp 2023-02-12 00:02:58,546 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(952): ClusterId : 713db996-2dec-40b6-8d8d-d0c99ed0ec24 2023-02-12 00:02:58,546 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(952): ClusterId : 713db996-2dec-40b6-8d8d-d0c99ed0ec24 2023-02-12 00:02:58,553 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:02:58,553 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:02:58,560 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:02:58,560 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:02:58,560 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:02:58,560 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:02:58,564 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:02:58,564 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:02:58,565 DEBUG [RS:0;jenkins-hbase9:44663] zookeeper.ReadOnlyZKClient(139): Connect 0x7af20f95 to 127.0.0.1:61225 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:02:58,565 DEBUG [RS:1;jenkins-hbase9:40797] zookeeper.ReadOnlyZKClient(139): Connect 0x7a04b44d to 127.0.0.1:61225 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:02:58,574 DEBUG [RS:0;jenkins-hbase9:44663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7435febb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:02:58,574 DEBUG [RS:1;jenkins-hbase9:40797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c3557d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:02:58,575 DEBUG [RS:0;jenkins-hbase9:44663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@700a64e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:02:58,575 DEBUG [RS:1;jenkins-hbase9:40797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70fcdf3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:02:58,598 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:40797 2023-02-12 00:02:58,601 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:44663 2023-02-12 00:02:58,604 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:02:58,606 INFO [RS:1;jenkins-hbase9:40797] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:02:58,606 INFO [RS:0;jenkins-hbase9:44663] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:02:58,606 INFO [RS:1;jenkins-hbase9:40797] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:02:58,606 INFO [RS:0;jenkins-hbase9:44663] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:02:58,606 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:02:58,606 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:02:58,609 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,32789,1676160176275 with isa=jenkins-hbase9.apache.org/172.31.2.10:44663, startcode=1676160177465 2023-02-12 00:02:58,609 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,32789,1676160176275 with isa=jenkins-hbase9.apache.org/172.31.2.10:40797, startcode=1676160177519 2023-02-12 00:02:58,618 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:02:58,618 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:02:58,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,629 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160208629 2023-02-12 00:02:58,631 DEBUG [RS:0;jenkins-hbase9:44663] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:02:58,634 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:02:58,634 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:02:58,635 DEBUG [RS:1;jenkins-hbase9:40797] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:02:58,635 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:02:58,641 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:02:58,648 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:02:58,656 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:02:58,657 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:02:58,658 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:02:58,658 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:02:58,664 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,671 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:02:58,673 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:02:58,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:02:58,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:02:58,681 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:02:58,686 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160178683,5,FailOnTimeoutGroup] 2023-02-12 00:02:58,687 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160178686,5,FailOnTimeoutGroup] 2023-02-12 00:02:58,687 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,687 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:02:58,689 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,706 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:02:58,707 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:02:58,708 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526 2023-02-12 00:02:58,710 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59359, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:02:58,710 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41339, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:02:58,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32789] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,748 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:02:58,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:02:58,754 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/info 2023-02-12 00:02:58,757 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:02:58,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:58,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:02:58,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:02:58,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:02:58,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:58,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:02:58,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/table 2023-02-12 00:02:58,766 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:02:58,767 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526 2023-02-12 00:02:58,768 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43363 2023-02-12 00:02:58,768 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:02:58,767 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526 2023-02-12 00:02:58,768 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43363 2023-02-12 00:02:58,768 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:02:58,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:58,773 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740 2023-02-12 00:02:58,777 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740 2023-02-12 00:02:58,777 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:02:58,781 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:02:58,783 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:02:58,785 DEBUG [RS:0;jenkins-hbase9:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,785 WARN [RS:0;jenkins-hbase9:44663] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:02:58,787 INFO [RS:0;jenkins-hbase9:44663] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:02:58,787 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,787 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44663,1676160177465] 2023-02-12 00:02:58,787 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,40797,1676160177519] 2023-02-12 00:02:58,791 DEBUG [RS:1;jenkins-hbase9:40797] zookeeper.ZKUtil(162): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,791 WARN [RS:1;jenkins-hbase9:40797] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:02:58,791 INFO [RS:1;jenkins-hbase9:40797] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:02:58,792 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,794 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:02:58,796 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72757312, jitterRate=0.0841684341430664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:02:58,796 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160178748Initializing all the Stores at 1676160178750 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160178750Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160178750Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160178750Cleaning up temporary data from old regions at 1676160178780 (+30 ms)Cleaning up detritus from prior splits at 1676160178780Region opened successfully at 1676160178796 (+16 ms) 2023-02-12 00:02:58,797 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:02:58,797 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:02:58,797 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:02:58,797 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:02:58,798 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:02:58,799 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:02:58,799 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160178797Disabling compacts and flushes for region at 1676160178797Disabling writes for close at 1676160178798 (+1 ms)Writing region close event to WAL at 1676160178799 (+1 ms)Closed at 1676160178799 2023-02-12 00:02:58,803 DEBUG [RS:0;jenkins-hbase9:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,805 DEBUG [RS:1;jenkins-hbase9:40797] zookeeper.ZKUtil(162): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,805 DEBUG [RS:0;jenkins-hbase9:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,806 DEBUG [RS:1;jenkins-hbase9:40797] zookeeper.ZKUtil(162): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,806 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:02:58,806 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:02:58,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:02:58,819 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:02:58,819 DEBUG [RS:0;jenkins-hbase9:44663] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:02:58,828 INFO [RS:0;jenkins-hbase9:44663] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:02:58,828 INFO [RS:1;jenkins-hbase9:40797] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:02:58,830 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:02:58,832 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:02:58,851 INFO [RS:0;jenkins-hbase9:44663] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:02:58,851 INFO [RS:1;jenkins-hbase9:40797] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:02:58,856 INFO [RS:1;jenkins-hbase9:40797] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:02:58,856 INFO [RS:0;jenkins-hbase9:44663] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:02:58,856 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,856 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,857 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:02:58,857 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:02:58,866 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,866 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,866 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,866 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,866 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,866 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:02:58,867 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,867 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,868 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,868 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,868 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,868 DEBUG [RS:1;jenkins-hbase9:40797] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,868 DEBUG [RS:0;jenkins-hbase9:44663] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:02:58,869 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,869 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,869 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,869 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,870 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,870 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,893 INFO [RS:1;jenkins-hbase9:40797] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:02:58,893 INFO [RS:0;jenkins-hbase9:44663] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:02:58,896 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40797,1676160177519-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,896 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44663,1676160177465-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:58,915 INFO [RS:0;jenkins-hbase9:44663] regionserver.Replication(203): jenkins-hbase9.apache.org,44663,1676160177465 started 2023-02-12 00:02:58,916 INFO [RS:1;jenkins-hbase9:40797] regionserver.Replication(203): jenkins-hbase9.apache.org,40797,1676160177519 started 2023-02-12 00:02:58,916 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,44663,1676160177465, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44663, sessionid=0x10045d76ced0001 2023-02-12 00:02:58,916 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,40797,1676160177519, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:40797, sessionid=0x10045d76ced0002 2023-02-12 00:02:58,916 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:02:58,916 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:02:58,916 DEBUG [RS:0;jenkins-hbase9:44663] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,916 DEBUG [RS:1;jenkins-hbase9:40797] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,917 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44663,1676160177465' 2023-02-12 00:02:58,917 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40797,1676160177519' 2023-02-12 00:02:58,917 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:02:58,917 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:02:58,918 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:02:58,918 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:02:58,919 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:02:58,919 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:02:58,919 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:02:58,919 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:02:58,919 DEBUG [RS:0;jenkins-hbase9:44663] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:02:58,919 DEBUG [RS:1;jenkins-hbase9:40797] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:58,919 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40797,1676160177519' 2023-02-12 00:02:58,919 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:02:58,919 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44663,1676160177465' 2023-02-12 00:02:58,920 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:02:58,920 DEBUG [RS:1;jenkins-hbase9:40797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:02:58,920 DEBUG [RS:0;jenkins-hbase9:44663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:02:58,921 DEBUG [RS:1;jenkins-hbase9:40797] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:02:58,921 INFO [RS:1;jenkins-hbase9:40797] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:02:58,921 DEBUG [RS:0;jenkins-hbase9:44663] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:02:58,921 INFO [RS:1;jenkins-hbase9:40797] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:02:58,921 INFO [RS:0;jenkins-hbase9:44663] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:02:58,921 INFO [RS:0;jenkins-hbase9:44663] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:02:58,984 DEBUG [jenkins-hbase9:32789] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:02:58,989 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:02:58,996 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:02:58,996 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:02:58,996 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:02:58,999 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40797,1676160177519, state=OPENING 2023-02-12 00:02:59,008 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:02:59,009 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:02:59,010 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:02:59,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:02:59,201 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:59,219 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:02:59,224 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:02:59,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:02:59,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:02:59,277 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40797%2C1676160177519.meta, suffix=.meta, logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,40797,1676160177519, archiveDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs, maxLogs=32 2023-02-12 00:02:59,344 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK] 2023-02-12 00:02:59,344 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK] 2023-02-12 00:02:59,350 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,40797,1676160177519/jenkins-hbase9.apache.org%2C40797%2C1676160177519.meta.1676160179283.meta 2023-02-12 00:02:59,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK]] 2023-02-12 00:02:59,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:02:59,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:02:59,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:02:59,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:02:59,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:02:59,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:02:59,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:02:59,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:02:59,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:02:59,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/info 2023-02-12 00:02:59,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/info 2023-02-12 00:02:59,388 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:02:59,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:59,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:02:59,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:02:59,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:02:59,391 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:02:59,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:59,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:02:59,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/table 2023-02-12 00:02:59,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/table 2023-02-12 00:02:59,394 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:02:59,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:02:59,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740 2023-02-12 00:02:59,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740 2023-02-12 00:02:59,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:02:59,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:02:59,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62546810, jitterRate=-0.06797990202903748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:02:59,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160179383Writing region info on filesystem at 1676160179383Initializing all the Stores at 1676160179385 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160179385Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160179385Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160179385Cleaning up temporary data from old regions at 1676160179401 (+16 ms)Cleaning up detritus from prior splits at 1676160179402 (+1 ms)Running coprocessor post-open hooks at 1676160179407 (+5 ms)Region opened successfully at 1676160179407 2023-02-12 00:02:59,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160179193 2023-02-12 00:02:59,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:02:59,436 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:02:59,436 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40797,1676160177519, state=OPEN 2023-02-12 00:02:59,439 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:02:59,439 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:02:59,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:02:59,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40797,1676160177519 in 425 msec 2023-02-12 00:02:59,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:02:59,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 628 msec 2023-02-12 00:02:59,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 926 msec 2023-02-12 00:02:59,454 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160177568, completionTime=-1 2023-02-12 00:02:59,454 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:02:59,454 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:02:59,521 DEBUG [hconnection-0x59227531-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:02:59,524 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:02:59,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:02:59,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160239542 2023-02-12 00:02:59,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160299542 2023-02-12 00:02:59,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 87 msec 2023-02-12 00:02:59,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1676160176275-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:59,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1676160176275-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:59,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1676160176275-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:59,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:32789, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:59,573 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:02:59,579 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:02:59,587 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:02:59,589 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:02:59,598 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:02:59,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:02:59,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:02:59,626 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:02:59,629 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45 empty. 2023-02-12 00:02:59,630 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:02:59,630 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:02:59,659 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:02:59,661 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6a163ef8889c8d0163ba65980a0aeb45, NAME => 'hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:02:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:02:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6a163ef8889c8d0163ba65980a0aeb45, disabling compactions & flushes 2023-02-12 00:02:59,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:02:59,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:02:59,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. after waiting 0 ms 2023-02-12 00:02:59,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:02:59,681 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:02:59,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6a163ef8889c8d0163ba65980a0aeb45: Waiting for close lock at 1676160179680Disabling compacts and flushes for region at 1676160179680Disabling writes for close at 1676160179681 (+1 ms)Writing region close event to WAL at 1676160179681Closed at 1676160179681 2023-02-12 00:02:59,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:02:59,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160179689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160179689"}]},"ts":"1676160179689"} 2023-02-12 00:02:59,729 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:02:59,732 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:02:59,736 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160179732"}]},"ts":"1676160179732"} 2023-02-12 00:02:59,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:02:59,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:02:59,748 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:02:59,748 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:02:59,748 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:02:59,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6a163ef8889c8d0163ba65980a0aeb45, ASSIGN}] 2023-02-12 00:02:59,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6a163ef8889c8d0163ba65980a0aeb45, ASSIGN 2023-02-12 00:02:59,756 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6a163ef8889c8d0163ba65980a0aeb45, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:02:59,909 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:02:59,910 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6a163ef8889c8d0163ba65980a0aeb45, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:02:59,910 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160179910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160179910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160179910"}]},"ts":"1676160179910"} 2023-02-12 00:02:59,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6a163ef8889c8d0163ba65980a0aeb45, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:02:59,932 INFO [RS:0;jenkins-hbase9:44663] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44663%2C1676160177465, suffix=, logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,44663,1676160177465, archiveDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs, maxLogs=32 2023-02-12 00:02:59,932 INFO [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40797%2C1676160177519, suffix=, logDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,40797,1676160177519, archiveDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs, maxLogs=32 2023-02-12 00:02:59,952 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK] 2023-02-12 00:02:59,954 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK] 2023-02-12 00:02:59,967 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK] 2023-02-12 00:02:59,967 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK] 2023-02-12 00:02:59,968 INFO [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,40797,1676160177519/jenkins-hbase9.apache.org%2C40797%2C1676160177519.1676160179935 2023-02-12 00:02:59,969 DEBUG [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK]] 2023-02-12 00:02:59,973 INFO [RS:0;jenkins-hbase9:44663] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/WALs/jenkins-hbase9.apache.org,44663,1676160177465/jenkins-hbase9.apache.org%2C44663%2C1676160177465.1676160179935 2023-02-12 00:02:59,975 DEBUG [RS:0;jenkins-hbase9:44663] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45693,DS-5738d7a6-3595-4f45-ab79-95c2b8dd88dc,DISK], DatanodeInfoWithStorage[127.0.0.1:36061,DS-ed4535ba-1f82-4389-913d-9967f2f91021,DISK]] 2023-02-12 00:03:00,076 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:00,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a163ef8889c8d0163ba65980a0aeb45, NAME => 'hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:00,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,080 INFO [StoreOpener-6a163ef8889c8d0163ba65980a0aeb45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,083 DEBUG [StoreOpener-6a163ef8889c8d0163ba65980a0aeb45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/info 2023-02-12 00:03:00,083 DEBUG [StoreOpener-6a163ef8889c8d0163ba65980a0aeb45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/info 2023-02-12 00:03:00,084 INFO [StoreOpener-6a163ef8889c8d0163ba65980a0aeb45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a163ef8889c8d0163ba65980a0aeb45 columnFamilyName info 2023-02-12 00:03:00,085 INFO [StoreOpener-6a163ef8889c8d0163ba65980a0aeb45-1] regionserver.HStore(310): Store=6a163ef8889c8d0163ba65980a0aeb45/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:00,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:00,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:00,096 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 6a163ef8889c8d0163ba65980a0aeb45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73108402, jitterRate=0.08940008282661438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:00,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 6a163ef8889c8d0163ba65980a0aeb45: Running coprocessor pre-open hook at 1676160180079Writing region info on filesystem at 1676160180079Initializing all the Stores at 1676160180080 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160180080Cleaning up temporary data from old regions at 1676160180088 (+8 ms)Cleaning up detritus from prior splits at 1676160180088Running coprocessor post-open hooks at 1676160180097 (+9 ms)Region opened successfully at 1676160180097 2023-02-12 00:03:00,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45., pid=6, masterSystemTime=1676160180070 2023-02-12 00:03:00,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:00,104 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:00,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6a163ef8889c8d0163ba65980a0aeb45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:00,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160180105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160180105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160180105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160180105"}]},"ts":"1676160180105"} 2023-02-12 00:03:00,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:00,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6a163ef8889c8d0163ba65980a0aeb45, server=jenkins-hbase9.apache.org,40797,1676160177519 in 197 msec 2023-02-12 00:03:00,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:00,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6a163ef8889c8d0163ba65980a0aeb45, ASSIGN in 365 msec 2023-02-12 00:03:00,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:00,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160180122"}]},"ts":"1676160180122"} 2023-02-12 00:03:00,126 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:00,129 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:00,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 540 msec 2023-02-12 00:03:00,214 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:00,217 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:00,217 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:00,255 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:00,274 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:00,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-02-12 00:03:00,289 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:00,301 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:00,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-12 00:03:00,315 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:00,319 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:00,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.738sec 2023-02-12 00:03:00,321 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:00,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:00,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:00,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1676160176275-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:00,325 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1676160176275-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:00,334 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:00,356 DEBUG [Listener at localhost/46331] zookeeper.ReadOnlyZKClient(139): Connect 0x002c6a35 to 127.0.0.1:61225 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:00,360 DEBUG [Listener at localhost/46331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33041538, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:00,397 DEBUG [hconnection-0x9fee92-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:00,409 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:00,423 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:03:00,423 DEBUG [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:00,434 DEBUG [Listener at localhost/46331] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:00,437 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51716, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:00,443 INFO [Listener at localhost/46331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 00:03:00,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-12 00:03:00,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:00,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.10:51716 deadline: 1676160240447, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 00:03:00,473 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 00:03:00,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:00,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 00:03:00,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:00,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:00,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 00:03:00,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:00,515 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:00,515 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:00,515 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 empty. 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:00,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 empty. 2023-02-12 00:03:00,517 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a empty. 2023-02-12 00:03:00,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:00,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:00,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 empty. 2023-02-12 00:03:00,519 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 empty. 2023-02-12 00:03:00,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:00,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:00,519 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:00,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a empty. 2023-02-12 00:03:00,520 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d empty. 2023-02-12 00:03:00,520 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa empty. 2023-02-12 00:03:00,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec empty. 2023-02-12 00:03:00,520 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 empty. 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:00,521 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:00,522 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:00,522 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 00:03:00,543 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:00,545 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e331257d7981c1dc09bd2e19ff7df76, NAME => 'testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,546 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a5da2a37445949e268556434df103c17, NAME => 'testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,546 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 005707d61c5389cc8c2b9af4dff134e8, NAME => 'testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7e331257d7981c1dc09bd2e19ff7df76, disabling compactions & flushes 2023-02-12 00:03:00,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:00,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:00,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. after waiting 0 ms 2023-02-12 00:03:00,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:00,594 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:00,594 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7e331257d7981c1dc09bd2e19ff7df76: Waiting for close lock at 1676160180593Disabling compacts and flushes for region at 1676160180593Disabling writes for close at 1676160180593Writing region close event to WAL at 1676160180594 (+1 ms)Closed at 1676160180594 2023-02-12 00:03:00,595 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c68bcf718d90cb234b46d265064fb201, NAME => 'testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 005707d61c5389cc8c2b9af4dff134e8, disabling compactions & flushes 2023-02-12 00:03:00,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:00,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:00,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. after waiting 0 ms 2023-02-12 00:03:00,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:00,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:00,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 005707d61c5389cc8c2b9af4dff134e8: Waiting for close lock at 1676160180596Disabling compacts and flushes for region at 1676160180596Disabling writes for close at 1676160180596Writing region close event to WAL at 1676160180596Closed at 1676160180596 2023-02-12 00:03:00,597 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0d38032d9a25e5f002a6df6fcb7b380a, NAME => 'testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:00,625 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0d38032d9a25e5f002a6df6fcb7b380a, disabling compactions & flushes 2023-02-12 00:03:00,626 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. after waiting 0 ms 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c68bcf718d90cb234b46d265064fb201, disabling compactions & flushes 2023-02-12 00:03:00,626 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:00,626 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0d38032d9a25e5f002a6df6fcb7b380a: Waiting for close lock at 1676160180626Disabling compacts and flushes for region at 1676160180626Disabling writes for close at 1676160180626Writing region close event to WAL at 1676160180626Closed at 1676160180626 2023-02-12 00:03:00,626 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:00,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. after waiting 0 ms 2023-02-12 00:03:00,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:00,627 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 45c3486300fabc1a4e982c268e52ef6a, NAME => 'testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,627 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:00,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c68bcf718d90cb234b46d265064fb201: Waiting for close lock at 1676160180626Disabling compacts and flushes for region at 1676160180626Disabling writes for close at 1676160180627 (+1 ms)Writing region close event to WAL at 1676160180627Closed at 1676160180627 2023-02-12 00:03:00,628 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d522d31bbaf37eb9d7fc875ea584af7d, NAME => 'testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 45c3486300fabc1a4e982c268e52ef6a, disabling compactions & flushes 2023-02-12 00:03:00,649 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. after waiting 0 ms 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:00,649 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 45c3486300fabc1a4e982c268e52ef6a: Waiting for close lock at 1676160180648Disabling compacts and flushes for region at 1676160180648Disabling writes for close at 1676160180649 (+1 ms)Writing region close event to WAL at 1676160180649Closed at 1676160180649 2023-02-12 00:03:00,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d522d31bbaf37eb9d7fc875ea584af7d, disabling compactions & flushes 2023-02-12 00:03:00,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:00,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:00,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. after waiting 0 ms 2023-02-12 00:03:00,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3d5cf19a47b0c396b100b821c6c490fa, NAME => 'testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:00,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:00,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d522d31bbaf37eb9d7fc875ea584af7d: Waiting for close lock at 1676160180649Disabling compacts and flushes for region at 1676160180649Disabling writes for close at 1676160180650 (+1 ms)Writing region close event to WAL at 1676160180650Closed at 1676160180650 2023-02-12 00:03:00,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b9bcd0f852c8daff2adb8807a7e91f69, NAME => 'testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,688 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,688 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b9bcd0f852c8daff2adb8807a7e91f69, disabling compactions & flushes 2023-02-12 00:03:00,689 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. after waiting 0 ms 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:00,689 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b9bcd0f852c8daff2adb8807a7e91f69: Waiting for close lock at 1676160180689Disabling compacts and flushes for region at 1676160180689Disabling writes for close at 1676160180689Writing region close event to WAL at 1676160180689Closed at 1676160180689 2023-02-12 00:03:00,689 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3d5cf19a47b0c396b100b821c6c490fa, disabling compactions & flushes 2023-02-12 00:03:00,690 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:00,690 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7e73b52318f6a98f237976687fcf4ec, NAME => 'testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp 2023-02-12 00:03:00,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:00,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. after waiting 0 ms 2023-02-12 00:03:00,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:00,690 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:00,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3d5cf19a47b0c396b100b821c6c490fa: Waiting for close lock at 1676160180689Disabling compacts and flushes for region at 1676160180689Disabling writes for close at 1676160180690 (+1 ms)Writing region close event to WAL at 1676160180690Closed at 1676160180690 2023-02-12 00:03:00,705 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,705 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c7e73b52318f6a98f237976687fcf4ec, disabling compactions & flushes 2023-02-12 00:03:00,706 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:00,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:00,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. after waiting 0 ms 2023-02-12 00:03:00,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:00,706 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:00,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c7e73b52318f6a98f237976687fcf4ec: Waiting for close lock at 1676160180705Disabling compacts and flushes for region at 1676160180705Disabling writes for close at 1676160180706 (+1 ms)Writing region close event to WAL at 1676160180706Closed at 1676160180706 2023-02-12 00:03:00,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a5da2a37445949e268556434df103c17, disabling compactions & flushes 2023-02-12 00:03:00,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. after waiting 0 ms 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:00,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:00,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a5da2a37445949e268556434df103c17: Waiting for close lock at 1676160180995Disabling compacts and flushes for region at 1676160180995Disabling writes for close at 1676160180995Writing region close event to WAL at 1676160180995Closed at 1676160180995 2023-02-12 00:03:01,001 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:01,003 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,003 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,003 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,003 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160181002"}]},"ts":"1676160181002"} 2023-02-12 00:03:01,061 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 00:03:01,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:01,064 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160181064"}]},"ts":"1676160181064"} 2023-02-12 00:03:01,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 00:03:01,072 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:01,084 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:01,084 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:01,084 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:01,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, ASSIGN}] 2023-02-12 00:03:01,089 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, ASSIGN 2023-02-12 00:03:01,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, ASSIGN 2023-02-12 00:03:01,090 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, ASSIGN 2023-02-12 00:03:01,090 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, ASSIGN 2023-02-12 00:03:01,092 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, ASSIGN 2023-02-12 00:03:01,092 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:03:01,092 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:03:01,092 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44663,1676160177465; forceNewPlan=false, retain=false 2023-02-12 00:03:01,092 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44663,1676160177465; forceNewPlan=false, retain=false 2023-02-12 00:03:01,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, ASSIGN 2023-02-12 00:03:01,094 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:03:01,094 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, ASSIGN 2023-02-12 00:03:01,094 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, ASSIGN 2023-02-12 00:03:01,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, ASSIGN 2023-02-12 00:03:01,095 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:03:01,095 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44663,1676160177465; forceNewPlan=false, retain=false 2023-02-12 00:03:01,095 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44663,1676160177465; forceNewPlan=false, retain=false 2023-02-12 00:03:01,095 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44663,1676160177465; forceNewPlan=false, retain=false 2023-02-12 00:03:01,095 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, ASSIGN 2023-02-12 00:03:01,097 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40797,1676160177519; forceNewPlan=false, retain=false 2023-02-12 00:03:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:01,242 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 00:03:01,246 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c68bcf718d90cb234b46d265064fb201, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,246 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a5da2a37445949e268556434df103c17, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,247 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d522d31bbaf37eb9d7fc875ea584af7d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181246"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181246"}]},"ts":"1676160181246"} 2023-02-12 00:03:01,247 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181247"}]},"ts":"1676160181247"} 2023-02-12 00:03:01,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3d5cf19a47b0c396b100b821c6c490fa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,247 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181247"}]},"ts":"1676160181247"} 2023-02-12 00:03:01,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=005707d61c5389cc8c2b9af4dff134e8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181246"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181246"}]},"ts":"1676160181246"} 2023-02-12 00:03:01,248 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181247"}]},"ts":"1676160181247"} 2023-02-12 00:03:01,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure a5da2a37445949e268556434df103c17, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:01,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure d522d31bbaf37eb9d7fc875ea584af7d, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:01,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure 3d5cf19a47b0c396b100b821c6c490fa, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:01,256 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9bcd0f852c8daff2adb8807a7e91f69, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,257 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181256"}]},"ts":"1676160181256"} 2023-02-12 00:03:01,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7e331257d7981c1dc09bd2e19ff7df76, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181258"}]},"ts":"1676160181258"} 2023-02-12 00:03:01,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure c68bcf718d90cb234b46d265064fb201, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:01,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 005707d61c5389cc8c2b9af4dff134e8, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:01,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=45c3486300fabc1a4e982c268e52ef6a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure b9bcd0f852c8daff2adb8807a7e91f69, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:01,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181262"}]},"ts":"1676160181262"} 2023-02-12 00:03:01,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 7e331257d7981c1dc09bd2e19ff7df76, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:01,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c7e73b52318f6a98f237976687fcf4ec, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,267 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181266"}]},"ts":"1676160181266"} 2023-02-12 00:03:01,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d38032d9a25e5f002a6df6fcb7b380a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160181268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160181268"}]},"ts":"1676160181268"} 2023-02-12 00:03:01,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure 45c3486300fabc1a4e982c268e52ef6a, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:01,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure c7e73b52318f6a98f237976687fcf4ec, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:01,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 0d38032d9a25e5f002a6df6fcb7b380a, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:01,404 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,404 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:01,408 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57796, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:01,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:01,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5da2a37445949e268556434df103c17, NAME => 'testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 00:03:01,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,423 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,428 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1 2023-02-12 00:03:01,428 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1 2023-02-12 00:03:01,429 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5da2a37445949e268556434df103c17 columnFamilyName f1 2023-02-12 00:03:01,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:01,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7e73b52318f6a98f237976687fcf4ec, NAME => 'testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 00:03:01,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,431 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(310): Store=a5da2a37445949e268556434df103c17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,436 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,438 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2 2023-02-12 00:03:01,438 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2 2023-02-12 00:03:01,438 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,438 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5da2a37445949e268556434df103c17 columnFamilyName f2 2023-02-12 00:03:01,439 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(310): Store=a5da2a37445949e268556434df103c17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,441 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f1 2023-02-12 00:03:01,441 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f1 2023-02-12 00:03:01,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,442 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7e73b52318f6a98f237976687fcf4ec columnFamilyName f1 2023-02-12 00:03:01,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,442 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(310): Store=c7e73b52318f6a98f237976687fcf4ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,443 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,445 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f2 2023-02-12 00:03:01,445 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f2 2023-02-12 00:03:01,446 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7e73b52318f6a98f237976687fcf4ec columnFamilyName f2 2023-02-12 00:03:01,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,446 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(310): Store=c7e73b52318f6a98f237976687fcf4ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a5da2a37445949e268556434df103c17 2023-02-12 00:03:01,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a5da2a37445949e268556434df103c17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72083764, jitterRate=0.0741317868232727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a5da2a37445949e268556434df103c17: Running coprocessor pre-open hook at 1676160181417Writing region info on filesystem at 1676160181417Initializing all the Stores at 1676160181419 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181419Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181423 (+4 ms)Cleaning up temporary data from old regions at 1676160181443 (+20 ms)Cleaning up detritus from prior splits at 1676160181444 (+1 ms)Running coprocessor post-open hooks at 1676160181465 (+21 ms)Region opened successfully at 1676160181465 2023-02-12 00:03:01,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17., pid=21, masterSystemTime=1676160181404 2023-02-12 00:03:01,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:01,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:01,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:01,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 005707d61c5389cc8c2b9af4dff134e8, NAME => 'testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 00:03:01,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,475 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=a5da2a37445949e268556434df103c17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,475 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181475"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181475"}]},"ts":"1676160181475"} 2023-02-12 00:03:01,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:01,478 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c7e73b52318f6a98f237976687fcf4ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58802669, jitterRate=-0.12377195060253143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c7e73b52318f6a98f237976687fcf4ec: Running coprocessor pre-open hook at 1676160181436Writing region info on filesystem at 1676160181436Initializing all the Stores at 1676160181438 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181438Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181438Cleaning up temporary data from old regions at 1676160181451 (+13 ms)Cleaning up detritus from prior splits at 1676160181451Running coprocessor post-open hooks at 1676160181482 (+31 ms)Region opened successfully at 1676160181482 2023-02-12 00:03:01,482 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1 2023-02-12 00:03:01,482 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1 2023-02-12 00:03:01,483 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005707d61c5389cc8c2b9af4dff134e8 columnFamilyName f1 2023-02-12 00:03:01,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec., pid=29, masterSystemTime=1676160181416 2023-02-12 00:03:01,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-12 00:03:01,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure a5da2a37445949e268556434df103c17, server=jenkins-hbase9.apache.org,44663,1676160177465 in 230 msec 2023-02-12 00:03:01,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:01,487 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(310): Store=005707d61c5389cc8c2b9af4dff134e8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:01,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:01,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d38032d9a25e5f002a6df6fcb7b380a, NAME => 'testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 00:03:01,487 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c7e73b52318f6a98f237976687fcf4ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181488"}]},"ts":"1676160181488"} 2023-02-12 00:03:01,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, ASSIGN in 401 msec 2023-02-12 00:03:01,490 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2 2023-02-12 00:03:01,491 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2 2023-02-12 00:03:01,492 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,492 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005707d61c5389cc8c2b9af4dff134e8 columnFamilyName f2 2023-02-12 00:03:01,493 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(310): Store=005707d61c5389cc8c2b9af4dff134e8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,494 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1 2023-02-12 00:03:01,495 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1 2023-02-12 00:03:01,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,495 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d38032d9a25e5f002a6df6fcb7b380a columnFamilyName f1 2023-02-12 00:03:01,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,496 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(310): Store=0d38032d9a25e5f002a6df6fcb7b380a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-12 00:03:01,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure c7e73b52318f6a98f237976687fcf4ec, server=jenkins-hbase9.apache.org,40797,1676160177519 in 219 msec 2023-02-12 00:03:01,497 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, ASSIGN in 412 msec 2023-02-12 00:03:01,500 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2 2023-02-12 00:03:01,500 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2 2023-02-12 00:03:01,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,502 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d38032d9a25e5f002a6df6fcb7b380a columnFamilyName f2 2023-02-12 00:03:01,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:01,503 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(310): Store=0d38032d9a25e5f002a6df6fcb7b380a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 005707d61c5389cc8c2b9af4dff134e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73286962, jitterRate=0.09206083416938782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 005707d61c5389cc8c2b9af4dff134e8: Running coprocessor pre-open hook at 1676160181475Writing region info on filesystem at 1676160181475Initializing all the Stores at 1676160181478 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181478Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181478Cleaning up temporary data from old regions at 1676160181498 (+20 ms)Cleaning up detritus from prior splits at 1676160181498Running coprocessor post-open hooks at 1676160181508 (+10 ms)Region opened successfully at 1676160181508 2023-02-12 00:03:01,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8., pid=25, masterSystemTime=1676160181404 2023-02-12 00:03:01,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:01,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:01,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:01,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d522d31bbaf37eb9d7fc875ea584af7d, NAME => 'testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 00:03:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,517 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=005707d61c5389cc8c2b9af4dff134e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,517 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181517"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181517"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181517"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181517"}]},"ts":"1676160181517"} 2023-02-12 00:03:01,519 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 0d38032d9a25e5f002a6df6fcb7b380a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69282260, jitterRate=0.03238612413406372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 0d38032d9a25e5f002a6df6fcb7b380a: Running coprocessor pre-open hook at 1676160181488Writing region info on filesystem at 1676160181488Initializing all the Stores at 1676160181489 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181490 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181491 (+1 ms)Cleaning up temporary data from old regions at 1676160181508 (+17 ms)Cleaning up detritus from prior splits at 1676160181510 (+2 ms)Running coprocessor post-open hooks at 1676160181524 (+14 ms)Region opened successfully at 1676160181524 2023-02-12 00:03:01,524 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1 2023-02-12 00:03:01,524 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1 2023-02-12 00:03:01,525 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d522d31bbaf37eb9d7fc875ea584af7d columnFamilyName f1 2023-02-12 00:03:01,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a., pid=30, masterSystemTime=1676160181416 2023-02-12 00:03:01,526 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(310): Store=d522d31bbaf37eb9d7fc875ea584af7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-12 00:03:01,526 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 005707d61c5389cc8c2b9af4dff134e8, server=jenkins-hbase9.apache.org,44663,1676160177465 in 263 msec 2023-02-12 00:03:01,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:01,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:01,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:01,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e331257d7981c1dc09bd2e19ff7df76, NAME => 'testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 00:03:01,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d38032d9a25e5f002a6df6fcb7b380a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181529"}]},"ts":"1676160181529"} 2023-02-12 00:03:01,529 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2 2023-02-12 00:03:01,529 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2 2023-02-12 00:03:01,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, ASSIGN in 441 msec 2023-02-12 00:03:01,530 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d522d31bbaf37eb9d7fc875ea584af7d columnFamilyName f2 2023-02-12 00:03:01,531 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(310): Store=d522d31bbaf37eb9d7fc875ea584af7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,532 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,537 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f1 2023-02-12 00:03:01,538 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f1 2023-02-12 00:03:01,538 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e331257d7981c1dc09bd2e19ff7df76 columnFamilyName f1 2023-02-12 00:03:01,544 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(310): Store=7e331257d7981c1dc09bd2e19ff7df76/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,544 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,546 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f2 2023-02-12 00:03:01,546 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f2 2023-02-12 00:03:01,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-12 00:03:01,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 0d38032d9a25e5f002a6df6fcb7b380a, server=jenkins-hbase9.apache.org,40797,1676160177519 in 262 msec 2023-02-12 00:03:01,547 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e331257d7981c1dc09bd2e19ff7df76 columnFamilyName f2 2023-02-12 00:03:01,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:01,548 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(310): Store=7e331257d7981c1dc09bd2e19ff7df76/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, ASSIGN in 462 msec 2023-02-12 00:03:01,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d522d31bbaf37eb9d7fc875ea584af7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66034908, jitterRate=-0.016003191471099854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d522d31bbaf37eb9d7fc875ea584af7d: Running coprocessor pre-open hook at 1676160181516Writing region info on filesystem at 1676160181516Initializing all the Stores at 1676160181518 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181519 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181519Cleaning up temporary data from old regions at 1676160181535 (+16 ms)Cleaning up detritus from prior splits at 1676160181543 (+8 ms)Running coprocessor post-open hooks at 1676160181553 (+10 ms)Region opened successfully at 1676160181553 2023-02-12 00:03:01,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d., pid=22, masterSystemTime=1676160181404 2023-02-12 00:03:01,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:01,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:01,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:01,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:01,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c68bcf718d90cb234b46d265064fb201, NAME => 'testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 00:03:01,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d522d31bbaf37eb9d7fc875ea584af7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181558"}]},"ts":"1676160181558"} 2023-02-12 00:03:01,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,561 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7e331257d7981c1dc09bd2e19ff7df76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71413345, jitterRate=0.06414176523685455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7e331257d7981c1dc09bd2e19ff7df76: Running coprocessor pre-open hook at 1676160181529Writing region info on filesystem at 1676160181529Initializing all the Stores at 1676160181531 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181531Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181531Cleaning up temporary data from old regions at 1676160181553 (+22 ms)Cleaning up detritus from prior splits at 1676160181553Running coprocessor post-open hooks at 1676160181563 (+10 ms)Region opened successfully at 1676160181563 2023-02-12 00:03:01,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76., pid=27, masterSystemTime=1676160181416 2023-02-12 00:03:01,565 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1 2023-02-12 00:03:01,565 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1 2023-02-12 00:03:01,566 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c68bcf718d90cb234b46d265064fb201 columnFamilyName f1 2023-02-12 00:03:01,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-12 00:03:01,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure d522d31bbaf37eb9d7fc875ea584af7d, server=jenkins-hbase9.apache.org,44663,1676160177465 in 310 msec 2023-02-12 00:03:01,567 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(310): Store=c68bcf718d90cb234b46d265064fb201/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,567 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:01,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:01,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9bcd0f852c8daff2adb8807a7e91f69, NAME => 'testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 00:03:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, ASSIGN in 482 msec 2023-02-12 00:03:01,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7e331257d7981c1dc09bd2e19ff7df76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,570 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2 2023-02-12 00:03:01,570 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2 2023-02-12 00:03:01,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160181570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181570"}]},"ts":"1676160181570"} 2023-02-12 00:03:01,571 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c68bcf718d90cb234b46d265064fb201 columnFamilyName f2 2023-02-12 00:03:01,573 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(310): Store=c68bcf718d90cb234b46d265064fb201/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,576 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-12 00:03:01,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 7e331257d7981c1dc09bd2e19ff7df76, server=jenkins-hbase9.apache.org,40797,1676160177519 in 310 msec 2023-02-12 00:03:01,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,578 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1 2023-02-12 00:03:01,579 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1 2023-02-12 00:03:01,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, ASSIGN in 492 msec 2023-02-12 00:03:01,579 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bcd0f852c8daff2adb8807a7e91f69 columnFamilyName f1 2023-02-12 00:03:01,581 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(310): Store=b9bcd0f852c8daff2adb8807a7e91f69/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,581 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:01,584 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2 2023-02-12 00:03:01,584 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2 2023-02-12 00:03:01,585 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bcd0f852c8daff2adb8807a7e91f69 columnFamilyName f2 2023-02-12 00:03:01,586 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(310): Store=b9bcd0f852c8daff2adb8807a7e91f69/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c68bcf718d90cb234b46d265064fb201; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67015432, jitterRate=-0.0013922452926635742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c68bcf718d90cb234b46d265064fb201: Running coprocessor pre-open hook at 1676160181559Writing region info on filesystem at 1676160181559Initializing all the Stores at 1676160181560 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181560Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181561 (+1 ms)Cleaning up temporary data from old regions at 1676160181579 (+18 ms)Cleaning up detritus from prior splits at 1676160181580 (+1 ms)Running coprocessor post-open hooks at 1676160181594 (+14 ms)Region opened successfully at 1676160181594 2023-02-12 00:03:01,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201., pid=24, masterSystemTime=1676160181404 2023-02-12 00:03:01,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:01,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:01,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:01,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3d5cf19a47b0c396b100b821c6c490fa, NAME => 'testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 00:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c68bcf718d90cb234b46d265064fb201, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181599"}]},"ts":"1676160181599"} 2023-02-12 00:03:01,602 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened b9bcd0f852c8daff2adb8807a7e91f69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67463614, jitterRate=0.005286186933517456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for b9bcd0f852c8daff2adb8807a7e91f69: Running coprocessor pre-open hook at 1676160181569Writing region info on filesystem at 1676160181569Initializing all the Stores at 1676160181570 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181570Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181575 (+5 ms)Cleaning up temporary data from old regions at 1676160181594 (+19 ms)Cleaning up detritus from prior splits at 1676160181595 (+1 ms)Running coprocessor post-open hooks at 1676160181604 (+9 ms)Region opened successfully at 1676160181604 2023-02-12 00:03:01,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69., pid=26, masterSystemTime=1676160181416 2023-02-12 00:03:01,605 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1 2023-02-12 00:03:01,605 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1 2023-02-12 00:03:01,605 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5cf19a47b0c396b100b821c6c490fa columnFamilyName f1 2023-02-12 00:03:01,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-12 00:03:01,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure c68bcf718d90cb234b46d265064fb201, server=jenkins-hbase9.apache.org,44663,1676160177465 in 343 msec 2023-02-12 00:03:01,606 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(310): Store=3d5cf19a47b0c396b100b821c6c490fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,606 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:01,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:01,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:01,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 45c3486300fabc1a4e982c268e52ef6a, NAME => 'testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 00:03:01,608 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9bcd0f852c8daff2adb8807a7e91f69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:01,608 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181608"}]},"ts":"1676160181608"} 2023-02-12 00:03:01,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, ASSIGN in 521 msec 2023-02-12 00:03:01,610 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2 2023-02-12 00:03:01,610 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2 2023-02-12 00:03:01,610 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5cf19a47b0c396b100b821c6c490fa columnFamilyName f2 2023-02-12 00:03:01,611 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(310): Store=3d5cf19a47b0c396b100b821c6c490fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,611 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,615 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1 2023-02-12 00:03:01,615 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1 2023-02-12 00:03:01,615 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c3486300fabc1a4e982c268e52ef6a columnFamilyName f1 2023-02-12 00:03:01,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-12 00:03:01,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure b9bcd0f852c8daff2adb8807a7e91f69, server=jenkins-hbase9.apache.org,40797,1676160177519 in 349 msec 2023-02-12 00:03:01,616 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(310): Store=45c3486300fabc1a4e982c268e52ef6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,616 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, ASSIGN in 530 msec 2023-02-12 00:03:01,618 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2 2023-02-12 00:03:01,618 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2 2023-02-12 00:03:01,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:01,619 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c3486300fabc1a4e982c268e52ef6a columnFamilyName f2 2023-02-12 00:03:01,620 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(310): Store=45c3486300fabc1a4e982c268e52ef6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:01,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 3d5cf19a47b0c396b100b821c6c490fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66961874, jitterRate=-0.002190321683883667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 3d5cf19a47b0c396b100b821c6c490fa: Running coprocessor pre-open hook at 1676160181599Writing region info on filesystem at 1676160181599Initializing all the Stores at 1676160181600 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181600Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181602 (+2 ms)Cleaning up temporary data from old regions at 1676160181615 (+13 ms)Cleaning up detritus from prior splits at 1676160181615Running coprocessor post-open hooks at 1676160181624 (+9 ms)Region opened successfully at 1676160181624 2023-02-12 00:03:01,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:01,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa., pid=23, masterSystemTime=1676160181404 2023-02-12 00:03:01,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:01,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:01,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3d5cf19a47b0c396b100b821c6c490fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:01,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181629"}]},"ts":"1676160181629"} 2023-02-12 00:03:01,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:01,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:01,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 45c3486300fabc1a4e982c268e52ef6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62238859, jitterRate=-0.07256872951984406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:01,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 45c3486300fabc1a4e982c268e52ef6a: Running coprocessor pre-open hook at 1676160181609Writing region info on filesystem at 1676160181609Initializing all the Stores at 1676160181610 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181610Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160181611 (+1 ms)Cleaning up temporary data from old regions at 1676160181623 (+12 ms)Cleaning up detritus from prior splits at 1676160181624 (+1 ms)Running coprocessor post-open hooks at 1676160181631 (+7 ms)Region opened successfully at 1676160181631 2023-02-12 00:03:01,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a., pid=28, masterSystemTime=1676160181416 2023-02-12 00:03:01,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:01,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:01,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-12 00:03:01,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure 3d5cf19a47b0c396b100b821c6c490fa, server=jenkins-hbase9.apache.org,44663,1676160177465 in 378 msec 2023-02-12 00:03:01,636 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=45c3486300fabc1a4e982c268e52ef6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:01,636 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160181636"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160181636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160181636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160181636"}]},"ts":"1676160181636"} 2023-02-12 00:03:01,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, ASSIGN in 551 msec 2023-02-12 00:03:01,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-12 00:03:01,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure 45c3486300fabc1a4e982c268e52ef6a, server=jenkins-hbase9.apache.org,40797,1676160177519 in 370 msec 2023-02-12 00:03:01,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-12 00:03:01,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, ASSIGN in 557 msec 2023-02-12 00:03:01,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:01,646 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160181646"}]},"ts":"1676160181646"} 2023-02-12 00:03:01,648 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 00:03:01,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:01,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1660 sec 2023-02-12 00:03:02,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:02,633 INFO [Listener at localhost/46331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 00:03:02,633 DEBUG [Listener at localhost/46331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 00:03:02,635 INFO [Listener at localhost/46331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:02,645 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 00:03:02,646 INFO [Listener at localhost/46331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:02,646 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 00:03:02,646 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:02,789 DEBUG [hconnection-0x9fee92-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:02,852 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:02,880 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40797] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:02,882 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44663] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:03,221 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:03,225 INFO [Listener at localhost/46331] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:03,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:03,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160183239 (current time:1676160183239). 2023-02-12 00:03:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x7b4c3e19 to 127.0.0.1:61225 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:03,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687243eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:03,257 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:03,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b4c3e19 to 127.0.0.1:61225 2023-02-12 00:03:03,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:03,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:03,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:03,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:03,290 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:03,291 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676160783291 2023-02-12 00:03:03,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:03,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 00:03:03,297 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:03,299 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:03,299 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:03,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:03,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 17 msec 2023-02-12 00:03:03,302 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:03,304 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676160783304 2023-02-12 00:03:03,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-12 00:03:03,343 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-12 00:03:03,343 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:03,344 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-12 00:03:03,344 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 00:03:03,345 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:03,345 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:03,347 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:03,347 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,347 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:03,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:03,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:03,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:03,348 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,348 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:03,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:03,349 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,349 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:03,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 00:03:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:03,350 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 00:03:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:03,351 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:03,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 00:03:03,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 00:03:03,362 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 00:03:03,362 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:03,362 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 00:03:03,363 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:03,363 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:03,379 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 00:03:03,379 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44663,1676160177465' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 00:03:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 00:03:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40797,1676160177519' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 00:03:03,391 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,391 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:03,392 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,392 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,392 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:03,392 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:03,393 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,393 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:03,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40797,1676160177519' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 00:03:03,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771f8700[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:03,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44663,1676160177465' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 00:03:03,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771f8700[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:03,399 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:03,400 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 00:03:03,400 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,402 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,403 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:03,403 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:03,403 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:03,404 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:03,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:03,405 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:03,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:03,406 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:03,415 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:03,415 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:03,415 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. started... 2023-02-12 00:03:03,433 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:03,433 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0d38032d9a25e5f002a6df6fcb7b380a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:03,433 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. started... 2023-02-12 00:03:03,447 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b9bcd0f852c8daff2adb8807a7e91f69 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:03,462 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:03,462 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:03,462 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:03,462 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. started... 2023-02-12 00:03:03,462 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. started... 2023-02-12 00:03:03,462 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:03,468 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:03,468 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. started... 2023-02-12 00:03:03,471 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:03,472 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:03,473 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d522d31bbaf37eb9d7fc875ea584af7d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:03,473 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a5da2a37445949e268556434df103c17 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:03,473 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 45c3486300fabc1a4e982c268e52ef6a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:03,475 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:03,475 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. started... 2023-02-12 00:03:03,479 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 005707d61c5389cc8c2b9af4dff134e8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:03,606 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:03,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:03,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:03,609 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 00:03:03,699 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f1/96b09ee4634d41f8a26ea7c6d42cb776 2023-02-12 00:03:03,708 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f1/0c3db8b559a7479a992a44a434bf8455 2023-02-12 00:03:03,709 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f1/44dcd20b79ba42b6b85c6198cd0a2498 2023-02-12 00:03:03,712 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f1/3e3852e2063e4360a94dae88ece6a751 2023-02-12 00:03:03,880 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f2/e479e945535d4e27913be98c90431aee 2023-02-12 00:03:03,881 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f2/0ece66e3e5a74907baad5619d5794bc8 2023-02-12 00:03:03,881 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f2/e1456f2607bb4c6e8de3613b234b50e1 2023-02-12 00:03:03,897 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f1/0c3db8b559a7479a992a44a434bf8455 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455 2023-02-12 00:03:03,897 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f1/44dcd20b79ba42b6b85c6198cd0a2498 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498 2023-02-12 00:03:03,898 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f1/96b09ee4634d41f8a26ea7c6d42cb776 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776 2023-02-12 00:03:03,909 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:03,910 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:03,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:03,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:03,911 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:03,911 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 00:03:03,914 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f2/0ece66e3e5a74907baad5619d5794bc8 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8 2023-02-12 00:03:03,914 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f2/e479e945535d4e27913be98c90431aee as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee 2023-02-12 00:03:03,915 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:03,916 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f2/e1456f2607bb4c6e8de3613b234b50e1 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1 2023-02-12 00:03:03,928 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:03,928 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:03,930 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a5da2a37445949e268556434df103c17 in 457ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:03,930 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0d38032d9a25e5f002a6df6fcb7b380a in 498ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:03,932 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:03,932 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 00:03:03,932 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 00:03:03,934 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b9bcd0f852c8daff2adb8807a7e91f69 in 487ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:03,934 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 00:03:03,936 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a5da2a37445949e268556434df103c17: 2023-02-12 00:03:03,936 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b9bcd0f852c8daff2adb8807a7e91f69: 2023-02-12 00:03:03,936 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0d38032d9a25e5f002a6df6fcb7b380a: 2023-02-12 00:03:03,937 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,937 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,937 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,942 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:03,942 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:03,942 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776] hfiles 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455] hfiles 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498] hfiles 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,945 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1] hfiles 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8] hfiles 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee] hfiles 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,949 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,968 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. completed. 2023-02-12 00:03:03,968 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:03,968 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:03,968 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:03,968 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. started... 2023-02-12 00:03:03,969 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. completed. 2023-02-12 00:03:03,969 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:03,969 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:03,969 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:03,969 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. started... 2023-02-12 00:03:03,969 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c7e73b52318f6a98f237976687fcf4ec: 2023-02-12 00:03:03,970 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3d5cf19a47b0c396b100b821c6c490fa 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. completed. 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:03,970 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:03,970 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. started... 2023-02-12 00:03:03,971 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7e331257d7981c1dc09bd2e19ff7df76: 2023-02-12 00:03:03,971 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:03,971 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:03,971 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:03,971 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:03,991 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. completed. 2023-02-12 00:03:03,991 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:03,991 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:03,996 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f1/2100120acf5a4d8d841efe88b151b4b6 2023-02-12 00:03:03,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. completed. 2023-02-12 00:03:03,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:03,996 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:04,020 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f2/a51ecdc3da4549c68c48b8d39dc8496f 2023-02-12 00:03:04,028 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f1/2100120acf5a4d8d841efe88b151b4b6 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6 2023-02-12 00:03:04,037 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,038 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f2/a51ecdc3da4549c68c48b8d39dc8496f as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f 2023-02-12 00:03:04,047 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,048 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3d5cf19a47b0c396b100b821c6c490fa in 78ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:04,048 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3d5cf19a47b0c396b100b821c6c490fa: 2023-02-12 00:03:04,048 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,048 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:04,048 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6] hfiles 2023-02-12 00:03:04,048 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,049 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f] hfiles 2023-02-12 00:03:04,049 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,059 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. completed. 2023-02-12 00:03:04,059 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:04,059 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:04,059 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:04,060 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. started... 2023-02-12 00:03:04,060 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c68bcf718d90cb234b46d265064fb201 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:04,076 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f1/3b415ee5e64845b0864979a0fd7faae6 2023-02-12 00:03:04,097 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 2023-02-12 00:03:04,104 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f1/3b415ee5e64845b0864979a0fd7faae6 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6 2023-02-12 00:03:04,112 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f1/4ff7d1810c7e4247b1b31f1bf25fe193 2023-02-12 00:03:04,112 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,113 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 2023-02-12 00:03:04,120 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f1/bad6aecf63ce4adf9bd70e898cb4b068 2023-02-12 00:03:04,121 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,122 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c68bcf718d90cb234b46d265064fb201 in 62ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c68bcf718d90cb234b46d265064fb201: 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6] hfiles 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03] hfiles 2023-02-12 00:03:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,149 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f2/fc927fee6e964d9b9e4922093be248f6 2023-02-12 00:03:04,153 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f2/a0340ae897c64492b55c95031ee72548 2023-02-12 00:03:04,157 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f1/4ff7d1810c7e4247b1b31f1bf25fe193 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193 2023-02-12 00:03:04,163 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f1/bad6aecf63ce4adf9bd70e898cb4b068 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068 2023-02-12 00:03:04,165 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,166 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f2/fc927fee6e964d9b9e4922093be248f6 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6 2023-02-12 00:03:04,171 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,174 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,175 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f2/a0340ae897c64492b55c95031ee72548 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548 2023-02-12 00:03:04,176 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 45c3486300fabc1a4e982c268e52ef6a in 703ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:04,176 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 45c3486300fabc1a4e982c268e52ef6a: 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193] hfiles 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6] hfiles 2023-02-12 00:03:04,177 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,196 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,198 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. completed. 2023-02-12 00:03:04,198 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:04,198 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d522d31bbaf37eb9d7fc875ea584af7d in 725ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:04,198 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:04,198 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d522d31bbaf37eb9d7fc875ea584af7d: 2023-02-12 00:03:04,198 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:04,199 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:04,199 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068] hfiles 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,199 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,40797,1676160177519' in zk 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548] hfiles 2023-02-12 00:03:04,199 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,205 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,205 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:04,205 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:04,205 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 00:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,40797,1676160177519': 2023-02-12 00:03:04,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40797,1676160177519' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 00:03:04,212 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. completed. 2023-02-12 00:03:04,212 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:04,212 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:04,281 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f2/67723503961e4dafaf9a059eda90a6ab 2023-02-12 00:03:04,289 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f1/3e3852e2063e4360a94dae88ece6a751 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751 2023-02-12 00:03:04,297 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,299 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f2/67723503961e4dafaf9a059eda90a6ab as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab 2023-02-12 00:03:04,306 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:04,308 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 005707d61c5389cc8c2b9af4dff134e8 in 829ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 005707d61c5389cc8c2b9af4dff134e8: 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751] hfiles 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751 for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab] hfiles 2023-02-12 00:03:04,308 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab for snapshot=testWithMapReduceMultiRegion 2023-02-12 00:03:04,317 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. completed. 2023-02-12 00:03:04,317 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:04,317 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:04,412 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:04,415 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 00:03:04,537 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. completed. 2023-02-12 00:03:04,537 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:04,537 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:04,538 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:04,538 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,538 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 00:03:04,538 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,44663,1676160177465' in zk 2023-02-12 00:03:04,541 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,541 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:04,541 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:04,541 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 00:03:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,44663,1676160177465': 2023-02-12 00:03:04,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44663,1676160177465' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:04,545 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-12 00:03:04,545 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:04,545 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:04,545 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-12 00:03:04,545 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:04,548 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:04,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,548 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,549 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:04,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:04,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:04,549 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,552 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:04,553 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 00:03:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,570 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:04,570 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:04,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:04,571 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:04,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-12 00:03:04,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:04,571 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:04,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-12 00:03:04,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:04,572 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:04,572 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 00:03:04,573 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 00:03:04,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 00:03:04,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-12 00:03:04,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-12 00:03:04,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 00:03:04,680 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 00:03:04,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676160183296Consolidate snapshot: testWithMapReduceMultiRegion at 1676160184572 (+1276 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676160184572Writing data manifest for testWithMapReduceMultiRegion at 1676160184601 (+29 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676160184620 (+19 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676160184679 (+59 ms) 2023-02-12 00:03:04,681 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:04,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3830 sec 2023-02-12 00:03:04,907 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 00:03:04,975 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 00:03:04,976 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 00:03:05,415 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:05,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:05,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:05,417 INFO [Listener at localhost/46331] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:05,429 INFO [Listener at localhost/46331] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:05,441 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:05,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40797] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:05,531 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44663] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:05,710 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:05,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:05,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 00:03:05,735 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 00:03:05,735 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:05,736 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 00:03:05,736 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 00:03:05,737 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:05,737 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:05,738 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:05,738 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:05,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:05,739 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:05,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:05,739 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:05,739 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:05,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:05,740 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:05,740 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:05,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:05,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:05,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:05,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:05,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:05,743 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:05,743 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:05,743 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:05,744 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:05,744 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:05,744 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:05,745 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:05,745 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:05,745 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. started... 2023-02-12 00:03:05,746 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. started... 2023-02-12 00:03:05,746 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d522d31bbaf37eb9d7fc875ea584af7d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,746 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d38032d9a25e5f002a6df6fcb7b380a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,746 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:05,747 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. started... 2023-02-12 00:03:05,747 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a5da2a37445949e268556434df103c17 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:05,747 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:05,748 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:05,748 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:05,748 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. started... 2023-02-12 00:03:05,748 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:05,748 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:05,748 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b9bcd0f852c8daff2adb8807a7e91f69 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:05,748 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. started... 2023-02-12 00:03:05,749 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 005707d61c5389cc8c2b9af4dff134e8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,748 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:05,749 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:05,749 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. started... 2023-02-12 00:03:05,749 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 45c3486300fabc1a4e982c268e52ef6a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,825 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f1/6b39ffee9a004fc98c228b542b0209ce 2023-02-12 00:03:05,825 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f1/b77ba8c190a140a68379c87c96e1c45b 2023-02-12 00:03:05,825 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f1/99c46405a1864d7ea2a49700ac1bba79 2023-02-12 00:03:05,826 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f1/d6c186f555eb4d6495f9f7a055cdcec3 2023-02-12 00:03:05,835 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f1/13fff6eedb40456c9ca1061359c8961a 2023-02-12 00:03:05,836 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f1/7ae4f49e84554f099fd49537f261647a 2023-02-12 00:03:05,883 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f2/12290f1a79bc4ea9bd62036ea2241a75 2023-02-12 00:03:05,894 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f1/b77ba8c190a140a68379c87c96e1c45b as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/b77ba8c190a140a68379c87c96e1c45b 2023-02-12 00:03:05,899 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f2/b240e0e315c44f59b6c728aa3305b016 2023-02-12 00:03:05,899 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f2/2b57e0bd32fc48d79f9d8cfe28f30138 2023-02-12 00:03:05,901 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/b77ba8c190a140a68379c87c96e1c45b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,904 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/.tmp/f2/12290f1a79bc4ea9bd62036ea2241a75 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/12290f1a79bc4ea9bd62036ea2241a75 2023-02-12 00:03:05,908 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f2/25575be1a00f41afb62e80e7d1465b9c 2023-02-12 00:03:05,909 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f1/6b39ffee9a004fc98c228b542b0209ce as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/6b39ffee9a004fc98c228b542b0209ce 2023-02-12 00:03:05,911 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f1/d6c186f555eb4d6495f9f7a055cdcec3 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/d6c186f555eb4d6495f9f7a055cdcec3 2023-02-12 00:03:05,920 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f1/99c46405a1864d7ea2a49700ac1bba79 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/99c46405a1864d7ea2a49700ac1bba79 2023-02-12 00:03:05,928 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/12290f1a79bc4ea9bd62036ea2241a75, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,929 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/6b39ffee9a004fc98c228b542b0209ce, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:05,929 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f2/2805fa253bea42828697cfc287fa0e32 2023-02-12 00:03:05,929 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/d6c186f555eb4d6495f9f7a055cdcec3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,931 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/.tmp/f2/2b57e0bd32fc48d79f9d8cfe28f30138 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/2b57e0bd32fc48d79f9d8cfe28f30138 2023-02-12 00:03:05,932 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 005707d61c5389cc8c2b9af4dff134e8 in 184ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:05,932 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 005707d61c5389cc8c2b9af4dff134e8: 2023-02-12 00:03:05,932 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:05,932 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:05,932 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:05,932 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. started... 2023-02-12 00:03:05,932 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f2/cf04909ec0d647c69ef39cd39f27fbc7 2023-02-12 00:03:05,932 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3d5cf19a47b0c396b100b821c6c490fa 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,933 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/99c46405a1864d7ea2a49700ac1bba79, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,933 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/.tmp/f2/b240e0e315c44f59b6c728aa3305b016 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/b240e0e315c44f59b6c728aa3305b016 2023-02-12 00:03:05,937 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/.tmp/f2/25575be1a00f41afb62e80e7d1465b9c as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/25575be1a00f41afb62e80e7d1465b9c 2023-02-12 00:03:05,987 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/2b57e0bd32fc48d79f9d8cfe28f30138, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:05,989 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a5da2a37445949e268556434df103c17 in 242ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:05,989 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a5da2a37445949e268556434df103c17: 2023-02-12 00:03:05,989 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:05,989 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:05,989 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. started... 2023-02-12 00:03:05,989 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c68bcf718d90cb234b46d265064fb201 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:05,991 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f1/13fff6eedb40456c9ca1061359c8961a as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/13fff6eedb40456c9ca1061359c8961a 2023-02-12 00:03:05,991 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:05,992 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f1/7ae4f49e84554f099fd49537f261647a as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/7ae4f49e84554f099fd49537f261647a 2023-02-12 00:03:05,994 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/b240e0e315c44f59b6c728aa3305b016, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,994 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/25575be1a00f41afb62e80e7d1465b9c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:05,995 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 45c3486300fabc1a4e982c268e52ef6a in 246ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:05,995 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0d38032d9a25e5f002a6df6fcb7b380a in 249ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:05,995 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 45c3486300fabc1a4e982c268e52ef6a: 2023-02-12 00:03:05,995 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d38032d9a25e5f002a6df6fcb7b380a: 2023-02-12 00:03:05,995 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:05,995 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. started... 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c7e73b52318f6a98f237976687fcf4ec: 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. started... 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7e331257d7981c1dc09bd2e19ff7df76: 2023-02-12 00:03:05,996 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:05,999 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:05,999 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:05,999 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:05,999 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:06,001 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/7ae4f49e84554f099fd49537f261647a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:06,001 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/13fff6eedb40456c9ca1061359c8961a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,002 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/.tmp/f2/2805fa253bea42828697cfc287fa0e32 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/2805fa253bea42828697cfc287fa0e32 2023-02-12 00:03:06,004 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/.tmp/f2/cf04909ec0d647c69ef39cd39f27fbc7 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/cf04909ec0d647c69ef39cd39f27fbc7 2023-02-12 00:03:06,012 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/cf04909ec0d647c69ef39cd39f27fbc7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,012 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/2805fa253bea42828697cfc287fa0e32, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:06,014 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d522d31bbaf37eb9d7fc875ea584af7d in 268ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:06,014 INFO [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b9bcd0f852c8daff2adb8807a7e91f69 in 266ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:06,014 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d522d31bbaf37eb9d7fc875ea584af7d: 2023-02-12 00:03:06,014 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9bcd0f852c8daff2adb8807a7e91f69: 2023-02-12 00:03:06,014 DEBUG [rs(jenkins-hbase9.apache.org,40797,1676160177519)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:06,014 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:06,014 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:06,014 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:06,014 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,015 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:06,015 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:06,015 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40797,1676160177519' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:06,018 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f1/6bbd108d7a784e55a714606764f97721 2023-02-12 00:03:06,020 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,020 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:06,020 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,020 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:06,022 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f1/a0e09556b5754081a56c645e7407f4de 2023-02-12 00:03:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:06,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40797,1676160177519' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 00:03:06,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1575211b[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:06,043 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f2/7f9cb54f309945ee8fa766c54127f698 2023-02-12 00:03:06,047 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f2/e160e8f31910496cb44c7c670fee83c7 2023-02-12 00:03:06,050 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f1/6bbd108d7a784e55a714606764f97721 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/6bbd108d7a784e55a714606764f97721 2023-02-12 00:03:06,053 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f1/a0e09556b5754081a56c645e7407f4de as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/a0e09556b5754081a56c645e7407f4de 2023-02-12 00:03:06,056 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/6bbd108d7a784e55a714606764f97721, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,057 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/.tmp/f2/7f9cb54f309945ee8fa766c54127f698 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/7f9cb54f309945ee8fa766c54127f698 2023-02-12 00:03:06,059 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/a0e09556b5754081a56c645e7407f4de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,060 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/.tmp/f2/e160e8f31910496cb44c7c670fee83c7 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/e160e8f31910496cb44c7c670fee83c7 2023-02-12 00:03:06,062 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/7f9cb54f309945ee8fa766c54127f698, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,064 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3d5cf19a47b0c396b100b821c6c490fa in 131ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:06,064 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3d5cf19a47b0c396b100b821c6c490fa: 2023-02-12 00:03:06,064 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:06,067 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/e160e8f31910496cb44c7c670fee83c7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:06,068 INFO [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c68bcf718d90cb234b46d265064fb201 in 79ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:06,068 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c68bcf718d90cb234b46d265064fb201: 2023-02-12 00:03:06,068 DEBUG [rs(jenkins-hbase9.apache.org,44663,1676160177465)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:06,068 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:06,068 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:06,068 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,068 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:06,068 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44663,1676160177465' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:06,071 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,071 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:06,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:06,072 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,072 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:06,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:06,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:06,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:06,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44663,1676160177465' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 00:03:06,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1575211b[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:06,074 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 00:03:06,074 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:06,077 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,40797,1676160177519' in zk 2023-02-12 00:03:06,077 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,44663,1676160177465' in zk 2023-02-12 00:03:06,077 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,077 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:06,079 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:06,079 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,079 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,079 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,079 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:06,079 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:06,079 DEBUG [member: 'jenkins-hbase9.apache.org,40797,1676160177519' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:06,080 DEBUG [member: 'jenkins-hbase9.apache.org,44663,1676160177465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,40797,1676160177519': 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40797,1676160177519' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,44663,1676160177465': 2023-02-12 00:03:06,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44663,1676160177465' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 00:03:06,088 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 00:03:06,088 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:06,088 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:06,088 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 00:03:06,088 INFO [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:06,090 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:06,090 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:06,090 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,091 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:06,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:06,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:06,091 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,094 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:06,094 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:06,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:06,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:06,101 DEBUG [(jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:06,101 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:06,102 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:06,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:06,102 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:06,102 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:06,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:06,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:06,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:06,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:06,104 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:06,104 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:06,204 DEBUG [Listener at localhost/46331] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:06,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:06,314 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop-1009117352615856768.jar 2023-02-12 00:03:06,332 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676160183239 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:06,333 DEBUG [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce 2023-02-12 00:03:06,334 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:06,334 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:06,334 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:06,334 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: a5da2a37445949e268556434df103c17 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(239): region to add: c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=0d38032d9a25e5f002a6df6fcb7b380a as 0d38032d9a25e5f002a6df6fcb7b380a in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,335 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=b9bcd0f852c8daff2adb8807a7e91f69 as b9bcd0f852c8daff2adb8807a7e91f69 in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=d522d31bbaf37eb9d7fc875ea584af7d as d522d31bbaf37eb9d7fc875ea584af7d in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=a5da2a37445949e268556434df103c17 as a5da2a37445949e268556434df103c17 in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=45c3486300fabc1a4e982c268e52ef6a as 45c3486300fabc1a4e982c268e52ef6a in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=c7e73b52318f6a98f237976687fcf4ec as c7e73b52318f6a98f237976687fcf4ec in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=005707d61c5389cc8c2b9af4dff134e8 as 005707d61c5389cc8c2b9af4dff134e8 in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=7e331257d7981c1dc09bd2e19ff7df76 as 7e331257d7981c1dc09bd2e19ff7df76 in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=3d5cf19a47b0c396b100b821c6c490fa as 3d5cf19a47b0c396b100b821c6c490fa in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,336 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(585): clone region=c68bcf718d90cb234b46d265064fb201 as c68bcf718d90cb234b46d265064fb201 in snapshot testWithMapReduceMultiRegion 2023-02-12 00:03:06,340 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b9bcd0f852c8daff2adb8807a7e91f69, NAME => 'testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,340 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => d522d31bbaf37eb9d7fc875ea584af7d, NAME => 'testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,340 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7e331257d7981c1dc09bd2e19ff7df76, NAME => 'testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,340 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 005707d61c5389cc8c2b9af4dff134e8, NAME => 'testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,341 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => a5da2a37445949e268556434df103c17, NAME => 'testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,341 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c7e73b52318f6a98f237976687fcf4ec, NAME => 'testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,341 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0d38032d9a25e5f002a6df6fcb7b380a, NAME => 'testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,342 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 45c3486300fabc1a4e982c268e52ef6a, NAME => 'testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,375 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,375 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c7e73b52318f6a98f237976687fcf4ec, disabling compactions & flushes 2023-02-12 00:03:06,375 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:06,375 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:06,375 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. after waiting 0 ms 2023-02-12 00:03:06,376 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:06,376 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:06,376 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c7e73b52318f6a98f237976687fcf4ec: Waiting for close lock at 1676160186375Disabling compacts and flushes for region at 1676160186375Disabling writes for close at 1676160186376 (+1 ms)Writing region close event to WAL at 1676160186376Closed at 1676160186376 2023-02-12 00:03:06,376 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3d5cf19a47b0c396b100b821c6c490fa, NAME => 'testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,388 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,388 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c3db8b559a7479a992a44a434bf8455 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,399 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e479e945535d4e27913be98c90431aee from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,399 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,400 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4ff7d1810c7e4247b1b31f1bf25fe193 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7e331257d7981c1dc09bd2e19ff7df76, disabling compactions & flushes 2023-02-12 00:03:06,404 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. after waiting 0 ms 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:06,404 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:06,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7e331257d7981c1dc09bd2e19ff7df76: Waiting for close lock at 1676160186404Disabling compacts and flushes for region at 1676160186404Disabling writes for close at 1676160186404Writing region close event to WAL at 1676160186404Closed at 1676160186404 2023-02-12 00:03:06,405 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => c68bcf718d90cb234b46d265064fb201, NAME => 'testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,407 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,407 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96b09ee4634d41f8a26ea7c6d42cb776 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,418 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,419 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 44dcd20b79ba42b6b85c6198cd0a2498 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,419 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fc927fee6e964d9b9e4922093be248f6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,423 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ece66e3e5a74907baad5619d5794bc8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,424 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1456f2607bb4c6e8de3613b234b50e1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b9bcd0f852c8daff2adb8807a7e91f69, disabling compactions & flushes 2023-02-12 00:03:06,424 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:06,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:06,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. after waiting 0 ms 2023-02-12 00:03:06,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:06,424 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:06,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b9bcd0f852c8daff2adb8807a7e91f69: Waiting for close lock at 1676160186424Disabling compacts and flushes for region at 1676160186424Disabling writes for close at 1676160186424Writing region close event to WAL at 1676160186424Closed at 1676160186424 2023-02-12 00:03:06,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 45c3486300fabc1a4e982c268e52ef6a, disabling compactions & flushes 2023-02-12 00:03:06,425 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:06,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:06,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. after waiting 0 ms 2023-02-12 00:03:06,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:06,425 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:06,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 45c3486300fabc1a4e982c268e52ef6a: Waiting for close lock at 1676160186425Disabling compacts and flushes for region at 1676160186425Disabling writes for close at 1676160186425Writing region close event to WAL at 1676160186425Closed at 1676160186425 2023-02-12 00:03:06,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,426 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bad6aecf63ce4adf9bd70e898cb4b068 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0d38032d9a25e5f002a6df6fcb7b380a, disabling compactions & flushes 2023-02-12 00:03:06,429 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:06,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:06,429 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. after waiting 0 ms 2023-02-12 00:03:06,429 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e3852e2063e4360a94dae88ece6a751 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:06,429 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0d38032d9a25e5f002a6df6fcb7b380a: Waiting for close lock at 1676160186429Disabling compacts and flushes for region at 1676160186429Disabling writes for close at 1676160186429Writing region close event to WAL at 1676160186429Closed at 1676160186429 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing a5da2a37445949e268556434df103c17, disabling compactions & flushes 2023-02-12 00:03:06,430 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. after waiting 0 ms 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,431 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2100120acf5a4d8d841efe88b151b4b6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,430 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:06,431 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:06,431 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for a5da2a37445949e268556434df103c17: Waiting for close lock at 1676160186430Disabling compacts and flushes for region at 1676160186430Disabling writes for close at 1676160186430Writing region close event to WAL at 1676160186431 (+1 ms)Closed at 1676160186431 2023-02-12 00:03:06,432 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0340ae897c64492b55c95031ee72548 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,433 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 67723503961e4dafaf9a059eda90a6ab from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,435 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:06,435 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:06,435 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b415ee5e64845b0864979a0fd7faae6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,435 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 00:03:06,436 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a51ecdc3da4549c68c48b8d39dc8496f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing d522d31bbaf37eb9d7fc875ea584af7d, disabling compactions & flushes 2023-02-12 00:03:06,437 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. after waiting 0 ms 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:06,437 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for d522d31bbaf37eb9d7fc875ea584af7d: Waiting for close lock at 1676160186437Disabling compacts and flushes for region at 1676160186437Disabling writes for close at 1676160186437Writing region close event to WAL at 1676160186437Closed at 1676160186437 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 005707d61c5389cc8c2b9af4dff134e8, disabling compactions & flushes 2023-02-12 00:03:06,437 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. after waiting 0 ms 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:06,437 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:06,437 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 005707d61c5389cc8c2b9af4dff134e8: Waiting for close lock at 1676160186437Disabling compacts and flushes for region at 1676160186437Disabling writes for close at 1676160186437Writing region close event to WAL at 1676160186437Closed at 1676160186437 2023-02-12 00:03:06,438 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c6ea4e119114f5f94d5ac8fb2bbcc03 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 00:03:06,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3d5cf19a47b0c396b100b821c6c490fa, disabling compactions & flushes 2023-02-12 00:03:06,439 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:06,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:06,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. after waiting 0 ms 2023-02-12 00:03:06,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:06,439 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:06,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3d5cf19a47b0c396b100b821c6c490fa: Waiting for close lock at 1676160186439Disabling compacts and flushes for region at 1676160186439Disabling writes for close at 1676160186439Writing region close event to WAL at 1676160186439Closed at 1676160186439 2023-02-12 00:03:06,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing c68bcf718d90cb234b46d265064fb201, disabling compactions & flushes 2023-02-12 00:03:06,441 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:06,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:06,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. after waiting 0 ms 2023-02-12 00:03:06,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:06,441 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:06,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for c68bcf718d90cb234b46d265064fb201: Waiting for close lock at 1676160186441Disabling compacts and flushes for region at 1676160186441Disabling writes for close at 1676160186441Writing region close event to WAL at 1676160186441Closed at 1676160186441 2023-02-12 00:03:06,441 INFO [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676160183239 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:06,441 DEBUG [Listener at localhost/46331] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,442 DEBUG [Listener at localhost/46331] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c 2023-02-12 00:03:06,442 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:06,443 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:06,443 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 00:03:06,444 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------005707d61c5389cc8c2b9af4dff134e8/ 2023-02-12 00:03:06,445 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,445 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,445 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=005707d61c5389cc8c2b9af4dff134e8-3e3852e2063e4360a94dae88ece6a751 2023-02-12 00:03:06,445 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,446 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=005707d61c5389cc8c2b9af4dff134e8-67723503961e4dafaf9a059eda90a6ab 2023-02-12 00:03:06,446 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------0d38032d9a25e5f002a6df6fcb7b380a/ 2023-02-12 00:03:06,446 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,446 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,447 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=0d38032d9a25e5f002a6df6fcb7b380a-44dcd20b79ba42b6b85c6198cd0a2498 2023-02-12 00:03:06,447 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,448 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=0d38032d9a25e5f002a6df6fcb7b380a-0ece66e3e5a74907baad5619d5794bc8 2023-02-12 00:03:06,448 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------3d5cf19a47b0c396b100b821c6c490fa/ 2023-02-12 00:03:06,448 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,448 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,449 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=3d5cf19a47b0c396b100b821c6c490fa-2100120acf5a4d8d841efe88b151b4b6 2023-02-12 00:03:06,449 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,449 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=3d5cf19a47b0c396b100b821c6c490fa-a51ecdc3da4549c68c48b8d39dc8496f 2023-02-12 00:03:06,450 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------45c3486300fabc1a4e982c268e52ef6a/ 2023-02-12 00:03:06,450 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,450 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,451 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=45c3486300fabc1a4e982c268e52ef6a-4ff7d1810c7e4247b1b31f1bf25fe193 2023-02-12 00:03:06,451 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,451 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=45c3486300fabc1a4e982c268e52ef6a-fc927fee6e964d9b9e4922093be248f6 2023-02-12 00:03:06,451 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------7e331257d7981c1dc09bd2e19ff7df76/ 2023-02-12 00:03:06,452 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,452 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------a5da2a37445949e268556434df103c17/ 2023-02-12 00:03:06,452 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,453 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,453 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=a5da2a37445949e268556434df103c17-96b09ee4634d41f8a26ea7c6d42cb776 2023-02-12 00:03:06,453 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,454 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=a5da2a37445949e268556434df103c17-e1456f2607bb4c6e8de3613b234b50e1 2023-02-12 00:03:06,454 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------b9bcd0f852c8daff2adb8807a7e91f69/ 2023-02-12 00:03:06,454 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,454 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,455 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=b9bcd0f852c8daff2adb8807a7e91f69-0c3db8b559a7479a992a44a434bf8455 2023-02-12 00:03:06,455 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,455 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=b9bcd0f852c8daff2adb8807a7e91f69-e479e945535d4e27913be98c90431aee 2023-02-12 00:03:06,455 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------c68bcf718d90cb234b46d265064fb201/ 2023-02-12 00:03:06,456 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,456 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,456 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=c68bcf718d90cb234b46d265064fb201-3b415ee5e64845b0864979a0fd7faae6 2023-02-12 00:03:06,457 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,457 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=c68bcf718d90cb234b46d265064fb201-9c6ea4e119114f5f94d5ac8fb2bbcc03 2023-02-12 00:03:06,457 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------c7e73b52318f6a98f237976687fcf4ec/ 2023-02-12 00:03:06,458 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,458 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |----------d522d31bbaf37eb9d7fc875ea584af7d/ 2023-02-12 00:03:06,458 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:06,458 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:06,459 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=d522d31bbaf37eb9d7fc875ea584af7d-bad6aecf63ce4adf9bd70e898cb4b068 2023-02-12 00:03:06,459 DEBUG [Listener at localhost/46331] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:06,459 DEBUG [Listener at localhost/46331] util.CommonFSUtils(702): |----------------testWithMapReduce=d522d31bbaf37eb9d7fc875ea584af7d-a0340ae897c64492b55c95031ee72548 2023-02-12 00:03:06,469 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:06,470 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:06,471 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:06,471 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,395 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop-213635146718354802.jar 2023-02-12 00:03:07,395 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,396 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,475 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop-4186699187958497937.jar 2023-02-12 00:03:07,476 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,476 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,477 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,477 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,478 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,478 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,479 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 00:03:07,479 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 00:03:07,480 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 00:03:07,480 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 00:03:07,481 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 00:03:07,481 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 00:03:07,482 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 00:03:07,482 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 00:03:07,483 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 00:03:07,484 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 00:03:07,490 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:07,490 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:07,491 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:07,492 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:07,492 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:07,570 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop-7079646208666145696.jar 2023-02-12 00:03:07,570 DEBUG [Listener at localhost/46331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:07,626 WARN [Listener at localhost/46331] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 00:03:07,638 WARN [Listener at localhost/46331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 00:03:07,655 INFO [Listener at localhost/46331] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 00:03:08,075 WARN [Listener at localhost/46331] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/mapreduce.cluster.local.dir/1676160187963/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 00:03:08,075 WARN [Listener at localhost/46331] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/mapreduce.cluster.local.dir/1676160187963/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 00:03:08,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:08,262 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:08,267 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:08,270 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:08,272 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f1 2023-02-12 00:03:08,273 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e331257d7981c1dc09bd2e19ff7df76 columnFamilyName f1 2023-02-12 00:03:08,274 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(310): Store=7e331257d7981c1dc09bd2e19ff7df76/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,274 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:08,275 DEBUG [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f2 2023-02-12 00:03:08,276 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e331257d7981c1dc09bd2e19ff7df76 columnFamilyName f2 2023-02-12 00:03:08,276 INFO [StoreOpener-7e331257d7981c1dc09bd2e19ff7df76-1] regionserver.HStore(310): Store=7e331257d7981c1dc09bd2e19ff7df76/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:08,277 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7e331257d7981c1dc09bd2e19ff7df76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67225167, jitterRate=0.001733049750328064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:08,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7e331257d7981c1dc09bd2e19ff7df76: Writing region info on filesystem at 1676160188268Initializing all the Stores at 1676160188269 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188269Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188270 (+1 ms)Region opened successfully at 1676160188277 (+7 ms) 2023-02-12 00:03:08,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7e331257d7981c1dc09bd2e19ff7df76, disabling compactions & flushes 2023-02-12 00:03:08,322 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:08,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:08,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. after waiting 0 ms 2023-02-12 00:03:08,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:08,322 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:08,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7e331257d7981c1dc09bd2e19ff7df76: Waiting for close lock at 1676160188322Disabling compacts and flushes for region at 1676160188322Disabling writes for close at 1676160188322Writing region close event to WAL at 1676160188322Closed at 1676160188322 2023-02-12 00:03:08,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:08,339 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:08,341 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:08,364 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:08,368 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1 2023-02-12 00:03:08,369 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005707d61c5389cc8c2b9af4dff134e8 columnFamilyName f1 2023-02-12 00:03:08,383 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/testWithMapReduce=005707d61c5389cc8c2b9af4dff134e8-3e3852e2063e4360a94dae88ece6a751 2023-02-12 00:03:08,384 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(310): Store=005707d61c5389cc8c2b9af4dff134e8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,384 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:08,385 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2 2023-02-12 00:03:08,386 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005707d61c5389cc8c2b9af4dff134e8 columnFamilyName f2 2023-02-12 00:03:08,393 DEBUG [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/testWithMapReduce=005707d61c5389cc8c2b9af4dff134e8-67723503961e4dafaf9a059eda90a6ab 2023-02-12 00:03:08,393 INFO [StoreOpener-005707d61c5389cc8c2b9af4dff134e8-1] regionserver.HStore(310): Store=005707d61c5389cc8c2b9af4dff134e8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:08,394 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 005707d61c5389cc8c2b9af4dff134e8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63098459, jitterRate=-0.05975969135761261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:08,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 005707d61c5389cc8c2b9af4dff134e8: Writing region info on filesystem at 1676160188341Initializing all the Stores at 1676160188343 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188343Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188363 (+20 ms)Region opened successfully at 1676160188394 (+31 ms) 2023-02-12 00:03:08,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 005707d61c5389cc8c2b9af4dff134e8, disabling compactions & flushes 2023-02-12 00:03:08,564 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:08,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:08,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. after waiting 0 ms 2023-02-12 00:03:08,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:08,581 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:08,581 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 005707d61c5389cc8c2b9af4dff134e8: Waiting for close lock at 1676160188564Disabling compacts and flushes for region at 1676160188564Disabling writes for close at 1676160188564Writing region close event to WAL at 1676160188581 (+17 ms)Closed at 1676160188581 2023-02-12 00:03:08,601 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:08,601 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:08,627 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:08,636 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:08,638 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1 2023-02-12 00:03:08,638 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bcd0f852c8daff2adb8807a7e91f69 columnFamilyName f1 2023-02-12 00:03:08,664 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/testWithMapReduce=b9bcd0f852c8daff2adb8807a7e91f69-0c3db8b559a7479a992a44a434bf8455 2023-02-12 00:03:08,665 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(310): Store=b9bcd0f852c8daff2adb8807a7e91f69/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,665 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:08,667 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2 2023-02-12 00:03:08,668 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bcd0f852c8daff2adb8807a7e91f69 columnFamilyName f2 2023-02-12 00:03:08,697 DEBUG [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/testWithMapReduce=b9bcd0f852c8daff2adb8807a7e91f69-e479e945535d4e27913be98c90431aee 2023-02-12 00:03:08,697 INFO [StoreOpener-b9bcd0f852c8daff2adb8807a7e91f69-1] regionserver.HStore(310): Store=b9bcd0f852c8daff2adb8807a7e91f69/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:08,698 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b9bcd0f852c8daff2adb8807a7e91f69; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61778771, jitterRate=-0.07942457497119904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:08,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b9bcd0f852c8daff2adb8807a7e91f69: Writing region info on filesystem at 1676160188627Initializing all the Stores at 1676160188628 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188628Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188635 (+7 ms)Region opened successfully at 1676160188698 (+63 ms) 2023-02-12 00:03:08,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b9bcd0f852c8daff2adb8807a7e91f69, disabling compactions & flushes 2023-02-12 00:03:08,823 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:08,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:08,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. after waiting 0 ms 2023-02-12 00:03:08,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:08,828 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:08,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b9bcd0f852c8daff2adb8807a7e91f69: Waiting for close lock at 1676160188823Disabling compacts and flushes for region at 1676160188823Disabling writes for close at 1676160188824 (+1 ms)Writing region close event to WAL at 1676160188828 (+4 ms)Closed at 1676160188828 2023-02-12 00:03:08,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:08,834 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:08,836 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:08,848 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:08,850 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f1 2023-02-12 00:03:08,850 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7e73b52318f6a98f237976687fcf4ec columnFamilyName f1 2023-02-12 00:03:08,851 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(310): Store=c7e73b52318f6a98f237976687fcf4ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,851 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:08,854 DEBUG [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f2 2023-02-12 00:03:08,854 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7e73b52318f6a98f237976687fcf4ec columnFamilyName f2 2023-02-12 00:03:08,863 INFO [StoreOpener-c7e73b52318f6a98f237976687fcf4ec-1] regionserver.HStore(310): Store=c7e73b52318f6a98f237976687fcf4ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:08,863 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c7e73b52318f6a98f237976687fcf4ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73994777, jitterRate=0.1026080995798111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:08,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c7e73b52318f6a98f237976687fcf4ec: Writing region info on filesystem at 1676160188837Initializing all the Stores at 1676160188838 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188838Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188847 (+9 ms)Region opened successfully at 1676160188863 (+16 ms) 2023-02-12 00:03:08,885 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c7e73b52318f6a98f237976687fcf4ec, disabling compactions & flushes 2023-02-12 00:03:08,886 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:08,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:08,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. after waiting 0 ms 2023-02-12 00:03:08,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:08,886 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:08,887 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c7e73b52318f6a98f237976687fcf4ec: Waiting for close lock at 1676160188885Disabling compacts and flushes for region at 1676160188885Disabling writes for close at 1676160188886 (+1 ms)Writing region close event to WAL at 1676160188886Closed at 1676160188886 2023-02-12 00:03:08,896 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:08,896 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:08,912 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:08,914 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:08,915 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1 2023-02-12 00:03:08,916 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5cf19a47b0c396b100b821c6c490fa columnFamilyName f1 2023-02-12 00:03:08,929 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/testWithMapReduce=3d5cf19a47b0c396b100b821c6c490fa-2100120acf5a4d8d841efe88b151b4b6 2023-02-12 00:03:08,929 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(310): Store=3d5cf19a47b0c396b100b821c6c490fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,929 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:08,930 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2 2023-02-12 00:03:08,930 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5cf19a47b0c396b100b821c6c490fa columnFamilyName f2 2023-02-12 00:03:08,936 DEBUG [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/testWithMapReduce=3d5cf19a47b0c396b100b821c6c490fa-a51ecdc3da4549c68c48b8d39dc8496f 2023-02-12 00:03:08,937 INFO [StoreOpener-3d5cf19a47b0c396b100b821c6c490fa-1] regionserver.HStore(310): Store=3d5cf19a47b0c396b100b821c6c490fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:08,937 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:08,937 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3d5cf19a47b0c396b100b821c6c490fa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65219326, jitterRate=-0.028156310319900513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:08,937 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3d5cf19a47b0c396b100b821c6c490fa: Writing region info on filesystem at 1676160188912Initializing all the Stores at 1676160188913 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188913Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160188913Region opened successfully at 1676160188937 (+24 ms) 2023-02-12 00:03:08,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3d5cf19a47b0c396b100b821c6c490fa, disabling compactions & flushes 2023-02-12 00:03:08,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:08,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:08,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. after waiting 0 ms 2023-02-12 00:03:08,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:09,000 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:09,000 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3d5cf19a47b0c396b100b821c6c490fa: Waiting for close lock at 1676160188989Disabling compacts and flushes for region at 1676160188989Disabling writes for close at 1676160188990 (+1 ms)Writing region close event to WAL at 1676160189000 (+10 ms)Closed at 1676160189000 2023-02-12 00:03:09,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:09,006 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:09,016 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:09,018 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5da2a37445949e268556434df103c17 2023-02-12 00:03:09,019 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1 2023-02-12 00:03:09,020 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5da2a37445949e268556434df103c17 columnFamilyName f1 2023-02-12 00:03:09,026 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/testWithMapReduce=a5da2a37445949e268556434df103c17-96b09ee4634d41f8a26ea7c6d42cb776 2023-02-12 00:03:09,027 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(310): Store=a5da2a37445949e268556434df103c17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,027 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5da2a37445949e268556434df103c17 2023-02-12 00:03:09,028 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2 2023-02-12 00:03:09,029 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5da2a37445949e268556434df103c17 columnFamilyName f2 2023-02-12 00:03:09,039 DEBUG [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/testWithMapReduce=a5da2a37445949e268556434df103c17-e1456f2607bb4c6e8de3613b234b50e1 2023-02-12 00:03:09,039 INFO [StoreOpener-a5da2a37445949e268556434df103c17-1] regionserver.HStore(310): Store=a5da2a37445949e268556434df103c17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,040 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:09,040 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a5da2a37445949e268556434df103c17; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62426591, jitterRate=-0.06977130472660065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:09,040 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a5da2a37445949e268556434df103c17: Writing region info on filesystem at 1676160189016Initializing all the Stores at 1676160189017 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189017Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189017Region opened successfully at 1676160189040 (+23 ms) 2023-02-12 00:03:09,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a5da2a37445949e268556434df103c17, disabling compactions & flushes 2023-02-12 00:03:09,091 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:09,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:09,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. after waiting 0 ms 2023-02-12 00:03:09,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:09,095 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:09,096 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a5da2a37445949e268556434df103c17: Waiting for close lock at 1676160189091Disabling compacts and flushes for region at 1676160189091Disabling writes for close at 1676160189091Writing region close event to WAL at 1676160189095 (+4 ms)Closed at 1676160189095 2023-02-12 00:03:09,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:09,101 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:09,104 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:09,106 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:09,107 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1 2023-02-12 00:03:09,107 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c3486300fabc1a4e982c268e52ef6a columnFamilyName f1 2023-02-12 00:03:09,115 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/testWithMapReduce=45c3486300fabc1a4e982c268e52ef6a-4ff7d1810c7e4247b1b31f1bf25fe193 2023-02-12 00:03:09,115 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(310): Store=45c3486300fabc1a4e982c268e52ef6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,115 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:09,116 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2 2023-02-12 00:03:09,116 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c3486300fabc1a4e982c268e52ef6a columnFamilyName f2 2023-02-12 00:03:09,123 DEBUG [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/testWithMapReduce=45c3486300fabc1a4e982c268e52ef6a-fc927fee6e964d9b9e4922093be248f6 2023-02-12 00:03:09,123 INFO [StoreOpener-45c3486300fabc1a4e982c268e52ef6a-1] regionserver.HStore(310): Store=45c3486300fabc1a4e982c268e52ef6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:09,123 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 45c3486300fabc1a4e982c268e52ef6a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69837434, jitterRate=0.0406588613986969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:09,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 45c3486300fabc1a4e982c268e52ef6a: Writing region info on filesystem at 1676160189104Initializing all the Stores at 1676160189105 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189105Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189105Region opened successfully at 1676160189123 (+18 ms) 2023-02-12 00:03:09,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 45c3486300fabc1a4e982c268e52ef6a, disabling compactions & flushes 2023-02-12 00:03:09,181 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:09,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:09,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. after waiting 0 ms 2023-02-12 00:03:09,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:09,187 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:09,188 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 45c3486300fabc1a4e982c268e52ef6a: Waiting for close lock at 1676160189180Disabling compacts and flushes for region at 1676160189180Disabling writes for close at 1676160189181 (+1 ms)Writing region close event to WAL at 1676160189187 (+6 ms)Closed at 1676160189187 2023-02-12 00:03:09,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:09,192 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:09,195 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:09,200 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:09,201 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1 2023-02-12 00:03:09,203 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c68bcf718d90cb234b46d265064fb201 columnFamilyName f1 2023-02-12 00:03:09,218 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/testWithMapReduce=c68bcf718d90cb234b46d265064fb201-3b415ee5e64845b0864979a0fd7faae6 2023-02-12 00:03:09,218 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(310): Store=c68bcf718d90cb234b46d265064fb201/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,218 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:09,219 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2 2023-02-12 00:03:09,220 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c68bcf718d90cb234b46d265064fb201 columnFamilyName f2 2023-02-12 00:03:09,231 DEBUG [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/testWithMapReduce=c68bcf718d90cb234b46d265064fb201-9c6ea4e119114f5f94d5ac8fb2bbcc03 2023-02-12 00:03:09,231 INFO [StoreOpener-c68bcf718d90cb234b46d265064fb201-1] regionserver.HStore(310): Store=c68bcf718d90cb234b46d265064fb201/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:09,231 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c68bcf718d90cb234b46d265064fb201; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69325443, jitterRate=0.033029600977897644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:09,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c68bcf718d90cb234b46d265064fb201: Writing region info on filesystem at 1676160189195Initializing all the Stores at 1676160189197 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189197Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189199 (+2 ms)Region opened successfully at 1676160189231 (+32 ms) 2023-02-12 00:03:09,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c68bcf718d90cb234b46d265064fb201, disabling compactions & flushes 2023-02-12 00:03:09,270 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:09,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:09,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. after waiting 0 ms 2023-02-12 00:03:09,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:09,292 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:09,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c68bcf718d90cb234b46d265064fb201: Waiting for close lock at 1676160189269Disabling compacts and flushes for region at 1676160189269Disabling writes for close at 1676160189270 (+1 ms)Writing region close event to WAL at 1676160189292 (+22 ms)Closed at 1676160189292 2023-02-12 00:03:09,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:09,305 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:09,308 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:09,312 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:09,315 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1 2023-02-12 00:03:09,315 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d522d31bbaf37eb9d7fc875ea584af7d columnFamilyName f1 2023-02-12 00:03:09,338 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/testWithMapReduce=d522d31bbaf37eb9d7fc875ea584af7d-bad6aecf63ce4adf9bd70e898cb4b068 2023-02-12 00:03:09,339 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(310): Store=d522d31bbaf37eb9d7fc875ea584af7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,339 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:09,340 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2 2023-02-12 00:03:09,341 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d522d31bbaf37eb9d7fc875ea584af7d columnFamilyName f2 2023-02-12 00:03:09,349 DEBUG [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/testWithMapReduce=d522d31bbaf37eb9d7fc875ea584af7d-a0340ae897c64492b55c95031ee72548 2023-02-12 00:03:09,350 INFO [StoreOpener-d522d31bbaf37eb9d7fc875ea584af7d-1] regionserver.HStore(310): Store=d522d31bbaf37eb9d7fc875ea584af7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:09,350 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d522d31bbaf37eb9d7fc875ea584af7d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72476241, jitterRate=0.07998014986515045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:09,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d522d31bbaf37eb9d7fc875ea584af7d: Writing region info on filesystem at 1676160189308Initializing all the Stores at 1676160189310 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189310Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189311 (+1 ms)Region opened successfully at 1676160189350 (+39 ms) 2023-02-12 00:03:09,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d522d31bbaf37eb9d7fc875ea584af7d, disabling compactions & flushes 2023-02-12 00:03:09,391 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:09,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:09,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. after waiting 0 ms 2023-02-12 00:03:09,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:09,397 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:09,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d522d31bbaf37eb9d7fc875ea584af7d: Waiting for close lock at 1676160189391Disabling compacts and flushes for region at 1676160189391Disabling writes for close at 1676160189391Writing region close event to WAL at 1676160189397 (+6 ms)Closed at 1676160189397 2023-02-12 00:03:09,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:09,402 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:09,403 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:09,406 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:09,407 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1 2023-02-12 00:03:09,407 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d38032d9a25e5f002a6df6fcb7b380a columnFamilyName f1 2023-02-12 00:03:09,420 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/testWithMapReduce=0d38032d9a25e5f002a6df6fcb7b380a-44dcd20b79ba42b6b85c6198cd0a2498 2023-02-12 00:03:09,420 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(310): Store=0d38032d9a25e5f002a6df6fcb7b380a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,421 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:09,422 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2 2023-02-12 00:03:09,422 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d38032d9a25e5f002a6df6fcb7b380a columnFamilyName f2 2023-02-12 00:03:09,433 DEBUG [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(539): loaded hdfs://localhost:43363/user/jenkins/test-data/04f42ad4-5a07-a9c7-9f75-983e030b27b9/testWithMapReduceMultiRegion/6d748ed7-f836-44c3-9a86-35034abf708c/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/testWithMapReduce=0d38032d9a25e5f002a6df6fcb7b380a-0ece66e3e5a74907baad5619d5794bc8 2023-02-12 00:03:09,433 INFO [StoreOpener-0d38032d9a25e5f002a6df6fcb7b380a-1] regionserver.HStore(310): Store=0d38032d9a25e5f002a6df6fcb7b380a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:09,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:09,433 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0d38032d9a25e5f002a6df6fcb7b380a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71249787, jitterRate=0.06170456111431122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:09,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0d38032d9a25e5f002a6df6fcb7b380a: Writing region info on filesystem at 1676160189403Initializing all the Stores at 1676160189404 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189404Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160189405 (+1 ms)Region opened successfully at 1676160189434 (+29 ms) 2023-02-12 00:03:09,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0d38032d9a25e5f002a6df6fcb7b380a, disabling compactions & flushes 2023-02-12 00:03:09,480 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:09,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:09,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. after waiting 0 ms 2023-02-12 00:03:09,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:09,496 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:09,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0d38032d9a25e5f002a6df6fcb7b380a: Waiting for close lock at 1676160189480Disabling compacts and flushes for region at 1676160189480Disabling writes for close at 1676160189480Writing region close event to WAL at 1676160189496 (+16 ms)Closed at 1676160189496 2023-02-12 00:03:10,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceMultiRegion" 2023-02-12 00:03:10,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-12 00:03:10,184 INFO [Listener at localhost/46331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 00:03:10,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-12 00:03:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160190195"}]},"ts":"1676160190195"} 2023-02-12 00:03:10,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:10,197 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 00:03:10,199 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 00:03:10,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, UNASSIGN}] 2023-02-12 00:03:10,205 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, UNASSIGN 2023-02-12 00:03:10,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, UNASSIGN 2023-02-12 00:03:10,205 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, UNASSIGN 2023-02-12 00:03:10,206 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, UNASSIGN 2023-02-12 00:03:10,206 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, UNASSIGN 2023-02-12 00:03:10,207 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=45c3486300fabc1a4e982c268e52ef6a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=005707d61c5389cc8c2b9af4dff134e8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,207 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c68bcf718d90cb234b46d265064fb201, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,207 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190207"}]},"ts":"1676160190207"} 2023-02-12 00:03:10,207 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190207"}]},"ts":"1676160190207"} 2023-02-12 00:03:10,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d38032d9a25e5f002a6df6fcb7b380a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,207 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190207"}]},"ts":"1676160190207"} 2023-02-12 00:03:10,207 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c7e73b52318f6a98f237976687fcf4ec, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190207"}]},"ts":"1676160190207"} 2023-02-12 00:03:10,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160190207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190207"}]},"ts":"1676160190207"} 2023-02-12 00:03:10,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure c68bcf718d90cb234b46d265064fb201, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:10,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure 45c3486300fabc1a4e982c268e52ef6a, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:10,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure 0d38032d9a25e5f002a6df6fcb7b380a, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:10,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=36, state=RUNNABLE; CloseRegionProcedure 005707d61c5389cc8c2b9af4dff134e8, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:10,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure c7e73b52318f6a98f237976687fcf4ec, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:10,221 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, UNASSIGN 2023-02-12 00:03:10,222 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, UNASSIGN 2023-02-12 00:03:10,222 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, UNASSIGN 2023-02-12 00:03:10,222 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, UNASSIGN 2023-02-12 00:03:10,222 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, UNASSIGN 2023-02-12 00:03:10,222 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b9bcd0f852c8daff2adb8807a7e91f69, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,222 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190222"}]},"ts":"1676160190222"} 2023-02-12 00:03:10,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3d5cf19a47b0c396b100b821c6c490fa, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190223"}]},"ts":"1676160190223"} 2023-02-12 00:03:10,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=a5da2a37445949e268556434df103c17, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,224 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190224"}]},"ts":"1676160190224"} 2023-02-12 00:03:10,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure b9bcd0f852c8daff2adb8807a7e91f69, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:10,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7e331257d7981c1dc09bd2e19ff7df76, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160190224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190224"}]},"ts":"1676160190224"} 2023-02-12 00:03:10,225 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d522d31bbaf37eb9d7fc875ea584af7d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160190225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160190225"}]},"ts":"1676160190225"} 2023-02-12 00:03:10,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 3d5cf19a47b0c396b100b821c6c490fa, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:10,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure a5da2a37445949e268556434df103c17, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:10,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 7e331257d7981c1dc09bd2e19ff7df76, server=jenkins-hbase9.apache.org,40797,1676160177519}] 2023-02-12 00:03:10,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=40, state=RUNNABLE; CloseRegionProcedure d522d31bbaf37eb9d7fc875ea584af7d, server=jenkins-hbase9.apache.org,44663,1676160177465}] 2023-02-12 00:03:10,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:10,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:10,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 005707d61c5389cc8c2b9af4dff134e8, disabling compactions & flushes 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c7e73b52318f6a98f237976687fcf4ec, disabling compactions & flushes 2023-02-12 00:03:10,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:10,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. after waiting 0 ms 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. after waiting 0 ms 2023-02-12 00:03:10,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:10,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:10,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec. 2023-02-12 00:03:10,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8. 2023-02-12 00:03:10,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c7e73b52318f6a98f237976687fcf4ec: Waiting for close lock at 1676160190372Running coprocessor pre-close hooks at 1676160190372Disabling compacts and flushes for region at 1676160190372Disabling writes for close at 1676160190372Writing region close event to WAL at 1676160190373 (+1 ms)Running coprocessor post-close hooks at 1676160190384 (+11 ms)Closed at 1676160190385 (+1 ms) 2023-02-12 00:03:10,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 005707d61c5389cc8c2b9af4dff134e8: Waiting for close lock at 1676160190372Running coprocessor pre-close hooks at 1676160190372Disabling compacts and flushes for region at 1676160190372Disabling writes for close at 1676160190372Writing region close event to WAL at 1676160190380 (+8 ms)Running coprocessor post-close hooks at 1676160190385 (+5 ms)Closed at 1676160190385 2023-02-12 00:03:10,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:10,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:10,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 3d5cf19a47b0c396b100b821c6c490fa, disabling compactions & flushes 2023-02-12 00:03:10,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:10,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:10,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. after waiting 0 ms 2023-02-12 00:03:10,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:10,388 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=005707d61c5389cc8c2b9af4dff134e8, regionState=CLOSED 2023-02-12 00:03:10,388 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190388"}]},"ts":"1676160190388"} 2023-02-12 00:03:10,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:10,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:10,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing b9bcd0f852c8daff2adb8807a7e91f69, disabling compactions & flushes 2023-02-12 00:03:10,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:10,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:10,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. after waiting 0 ms 2023-02-12 00:03:10,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:10,390 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c7e73b52318f6a98f237976687fcf4ec, regionState=CLOSED 2023-02-12 00:03:10,390 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160190390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190390"}]},"ts":"1676160190390"} 2023-02-12 00:03:10,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=36 2023-02-12 00:03:10,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=36, state=SUCCESS; CloseRegionProcedure 005707d61c5389cc8c2b9af4dff134e8, server=jenkins-hbase9.apache.org,44663,1676160177465 in 177 msec 2023-02-12 00:03:10,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa. 2023-02-12 00:03:10,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 3d5cf19a47b0c396b100b821c6c490fa: Waiting for close lock at 1676160190388Running coprocessor pre-close hooks at 1676160190388Disabling compacts and flushes for region at 1676160190388Disabling writes for close at 1676160190388Writing region close event to WAL at 1676160190394 (+6 ms)Running coprocessor post-close hooks at 1676160190398 (+4 ms)Closed at 1676160190400 (+2 ms) 2023-02-12 00:03:10,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-12 00:03:10,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure c7e73b52318f6a98f237976687fcf4ec, server=jenkins-hbase9.apache.org,40797,1676160177519 in 178 msec 2023-02-12 00:03:10,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=005707d61c5389cc8c2b9af4dff134e8, UNASSIGN in 198 msec 2023-02-12 00:03:10,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:10,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:10,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7e73b52318f6a98f237976687fcf4ec, UNASSIGN in 198 msec 2023-02-12 00:03:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d522d31bbaf37eb9d7fc875ea584af7d, disabling compactions & flushes 2023-02-12 00:03:10,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. after waiting 0 ms 2023-02-12 00:03:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:10,403 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3d5cf19a47b0c396b100b821c6c490fa, regionState=CLOSED 2023-02-12 00:03:10,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190403"}]},"ts":"1676160190403"} 2023-02-12 00:03:10,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 00:03:10,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 3d5cf19a47b0c396b100b821c6c490fa, server=jenkins-hbase9.apache.org,44663,1676160177465 in 180 msec 2023-02-12 00:03:10,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69. 2023-02-12 00:03:10,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for b9bcd0f852c8daff2adb8807a7e91f69: Waiting for close lock at 1676160190390Running coprocessor pre-close hooks at 1676160190390Disabling compacts and flushes for region at 1676160190390Disabling writes for close at 1676160190390Writing region close event to WAL at 1676160190405 (+15 ms)Running coprocessor post-close hooks at 1676160190412 (+7 ms)Closed at 1676160190412 2023-02-12 00:03:10,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3d5cf19a47b0c396b100b821c6c490fa, UNASSIGN in 210 msec 2023-02-12 00:03:10,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:10,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:10,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 45c3486300fabc1a4e982c268e52ef6a, disabling compactions & flushes 2023-02-12 00:03:10,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:10,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:10,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. after waiting 0 ms 2023-02-12 00:03:10,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:10,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b9bcd0f852c8daff2adb8807a7e91f69, regionState=CLOSED 2023-02-12 00:03:10,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190415"}]},"ts":"1676160190415"} 2023-02-12 00:03:10,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 00:03:10,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure b9bcd0f852c8daff2adb8807a7e91f69, server=jenkins-hbase9.apache.org,40797,1676160177519 in 194 msec 2023-02-12 00:03:10,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b9bcd0f852c8daff2adb8807a7e91f69, UNASSIGN in 217 msec 2023-02-12 00:03:10,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d. 2023-02-12 00:03:10,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d522d31bbaf37eb9d7fc875ea584af7d: Waiting for close lock at 1676160190403Running coprocessor pre-close hooks at 1676160190403Disabling compacts and flushes for region at 1676160190403Disabling writes for close at 1676160190403Writing region close event to WAL at 1676160190412 (+9 ms)Running coprocessor post-close hooks at 1676160190427 (+15 ms)Closed at 1676160190427 2023-02-12 00:03:10,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:10,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:10,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c68bcf718d90cb234b46d265064fb201, disabling compactions & flushes 2023-02-12 00:03:10,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:10,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:10,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. after waiting 0 ms 2023-02-12 00:03:10,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:10,431 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d522d31bbaf37eb9d7fc875ea584af7d, regionState=CLOSED 2023-02-12 00:03:10,432 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190431"}]},"ts":"1676160190431"} 2023-02-12 00:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a. 2023-02-12 00:03:10,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 45c3486300fabc1a4e982c268e52ef6a: Waiting for close lock at 1676160190415Running coprocessor pre-close hooks at 1676160190415Disabling compacts and flushes for region at 1676160190415Disabling writes for close at 1676160190415Writing region close event to WAL at 1676160190427 (+12 ms)Running coprocessor post-close hooks at 1676160190435 (+8 ms)Closed at 1676160190435 2023-02-12 00:03:10,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=40 2023-02-12 00:03:10,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=40, state=SUCCESS; CloseRegionProcedure d522d31bbaf37eb9d7fc875ea584af7d, server=jenkins-hbase9.apache.org,44663,1676160177465 in 202 msec 2023-02-12 00:03:10,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:10,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:10,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7e331257d7981c1dc09bd2e19ff7df76, disabling compactions & flushes 2023-02-12 00:03:10,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:10,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:10,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. after waiting 0 ms 2023-02-12 00:03:10,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:10,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d522d31bbaf37eb9d7fc875ea584af7d, UNASSIGN in 235 msec 2023-02-12 00:03:10,438 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=45c3486300fabc1a4e982c268e52ef6a, regionState=CLOSED 2023-02-12 00:03:10,439 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190438"}]},"ts":"1676160190438"} 2023-02-12 00:03:10,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201. 2023-02-12 00:03:10,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c68bcf718d90cb234b46d265064fb201: Waiting for close lock at 1676160190430Running coprocessor pre-close hooks at 1676160190430Disabling compacts and flushes for region at 1676160190430Disabling writes for close at 1676160190430Writing region close event to WAL at 1676160190435 (+5 ms)Running coprocessor post-close hooks at 1676160190440 (+5 ms)Closed at 1676160190441 (+1 ms) 2023-02-12 00:03:10,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:10,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:10,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close a5da2a37445949e268556434df103c17 2023-02-12 00:03:10,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76. 2023-02-12 00:03:10,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a5da2a37445949e268556434df103c17, disabling compactions & flushes 2023-02-12 00:03:10,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7e331257d7981c1dc09bd2e19ff7df76: Waiting for close lock at 1676160190437Running coprocessor pre-close hooks at 1676160190437Disabling compacts and flushes for region at 1676160190437Disabling writes for close at 1676160190438 (+1 ms)Writing region close event to WAL at 1676160190438Running coprocessor post-close hooks at 1676160190443 (+5 ms)Closed at 1676160190443 2023-02-12 00:03:10,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:10,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:10,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. after waiting 0 ms 2023-02-12 00:03:10,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:10,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c68bcf718d90cb234b46d265064fb201, regionState=CLOSED 2023-02-12 00:03:10,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190444"}]},"ts":"1676160190444"} 2023-02-12 00:03:10,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-12 00:03:10,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure 45c3486300fabc1a4e982c268e52ef6a, server=jenkins-hbase9.apache.org,40797,1676160177519 in 230 msec 2023-02-12 00:03:10,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:10,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:10,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 0d38032d9a25e5f002a6df6fcb7b380a, disabling compactions & flushes 2023-02-12 00:03:10,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:10,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:10,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. after waiting 0 ms 2023-02-12 00:03:10,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:10,447 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7e331257d7981c1dc09bd2e19ff7df76, regionState=CLOSED 2023-02-12 00:03:10,447 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160190447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190447"}]},"ts":"1676160190447"} 2023-02-12 00:03:10,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45c3486300fabc1a4e982c268e52ef6a, UNASSIGN in 245 msec 2023-02-12 00:03:10,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-12 00:03:10,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure c68bcf718d90cb234b46d265064fb201, server=jenkins-hbase9.apache.org,44663,1676160177465 in 237 msec 2023-02-12 00:03:10,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c68bcf718d90cb234b46d265064fb201, UNASSIGN in 249 msec 2023-02-12 00:03:10,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-12 00:03:10,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 7e331257d7981c1dc09bd2e19ff7df76, server=jenkins-hbase9.apache.org,40797,1676160177519 in 220 msec 2023-02-12 00:03:10,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17. 2023-02-12 00:03:10,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a5da2a37445949e268556434df103c17: Waiting for close lock at 1676160190443Running coprocessor pre-close hooks at 1676160190443Disabling compacts and flushes for region at 1676160190443Disabling writes for close at 1676160190444 (+1 ms)Writing region close event to WAL at 1676160190446 (+2 ms)Running coprocessor post-close hooks at 1676160190452 (+6 ms)Closed at 1676160190453 (+1 ms) 2023-02-12 00:03:10,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:10,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a. 2023-02-12 00:03:10,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 0d38032d9a25e5f002a6df6fcb7b380a: Waiting for close lock at 1676160190446Running coprocessor pre-close hooks at 1676160190446Disabling compacts and flushes for region at 1676160190446Disabling writes for close at 1676160190446Writing region close event to WAL at 1676160190449 (+3 ms)Running coprocessor post-close hooks at 1676160190454 (+5 ms)Closed at 1676160190455 (+1 ms) 2023-02-12 00:03:10,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e331257d7981c1dc09bd2e19ff7df76, UNASSIGN in 251 msec 2023-02-12 00:03:10,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed a5da2a37445949e268556434df103c17 2023-02-12 00:03:10,456 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=a5da2a37445949e268556434df103c17, regionState=CLOSED 2023-02-12 00:03:10,456 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190456"}]},"ts":"1676160190456"} 2023-02-12 00:03:10,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:10,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d38032d9a25e5f002a6df6fcb7b380a, regionState=CLOSED 2023-02-12 00:03:10,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160190458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160190458"}]},"ts":"1676160190458"} 2023-02-12 00:03:10,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-12 00:03:10,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-12 00:03:10,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure a5da2a37445949e268556434df103c17, server=jenkins-hbase9.apache.org,44663,1676160177465 in 230 msec 2023-02-12 00:03:10,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure 0d38032d9a25e5f002a6df6fcb7b380a, server=jenkins-hbase9.apache.org,40797,1676160177519 in 247 msec 2023-02-12 00:03:10,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a5da2a37445949e268556434df103c17, UNASSIGN in 261 msec 2023-02-12 00:03:10,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-12 00:03:10,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0d38032d9a25e5f002a6df6fcb7b380a, UNASSIGN in 261 msec 2023-02-12 00:03:10,465 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160190465"}]},"ts":"1676160190465"} 2023-02-12 00:03:10,467 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 00:03:10,469 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 00:03:10,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 284 msec 2023-02-12 00:03:10,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:10,501 INFO [Listener at localhost/46331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-12 00:03:10,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-12 00:03:10,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,537 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,540 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 00:03:10,561 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:10,561 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:10,561 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:10,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:10,561 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:10,562 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:10,563 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:10,563 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:10,570 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/recovered.edits] 2023-02-12 00:03:10,570 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/recovered.edits] 2023-02-12 00:03:10,570 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/recovered.edits] 2023-02-12 00:03:10,570 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/recovered.edits] 2023-02-12 00:03:10,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/recovered.edits] 2023-02-12 00:03:10,573 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/recovered.edits] 2023-02-12 00:03:10,573 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/recovered.edits] 2023-02-12 00:03:10,575 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/recovered.edits] 2023-02-12 00:03:10,592 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/3e3852e2063e4360a94dae88ece6a751 2023-02-12 00:03:10,592 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/44dcd20b79ba42b6b85c6198cd0a2498 2023-02-12 00:03:10,596 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/4ff7d1810c7e4247b1b31f1bf25fe193 2023-02-12 00:03:10,598 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/13fff6eedb40456c9ca1061359c8961a to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/13fff6eedb40456c9ca1061359c8961a 2023-02-12 00:03:10,598 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/6b39ffee9a004fc98c228b542b0209ce to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/6b39ffee9a004fc98c228b542b0209ce 2023-02-12 00:03:10,598 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/2100120acf5a4d8d841efe88b151b4b6 2023-02-12 00:03:10,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/3b415ee5e64845b0864979a0fd7faae6 2023-02-12 00:03:10,604 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f1/bad6aecf63ce4adf9bd70e898cb4b068 2023-02-12 00:03:10,605 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/d6c186f555eb4d6495f9f7a055cdcec3 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f1/d6c186f555eb4d6495f9f7a055cdcec3 2023-02-12 00:03:10,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/6bbd108d7a784e55a714606764f97721 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f1/6bbd108d7a784e55a714606764f97721 2023-02-12 00:03:10,608 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f1/96b09ee4634d41f8a26ea7c6d42cb776 2023-02-12 00:03:10,608 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/99c46405a1864d7ea2a49700ac1bba79 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f1/99c46405a1864d7ea2a49700ac1bba79 2023-02-12 00:03:10,608 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/a0e09556b5754081a56c645e7407f4de to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f1/a0e09556b5754081a56c645e7407f4de 2023-02-12 00:03:10,609 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/b77ba8c190a140a68379c87c96e1c45b to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f1/b77ba8c190a140a68379c87c96e1c45b 2023-02-12 00:03:10,609 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/recovered.edits/6.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76/recovered.edits/6.seqid 2023-02-12 00:03:10,611 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/7e331257d7981c1dc09bd2e19ff7df76 2023-02-12 00:03:10,611 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:10,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 00:03:10,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/a0340ae897c64492b55c95031ee72548 2023-02-12 00:03:10,678 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/recovered.edits] 2023-02-12 00:03:10,679 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/0ece66e3e5a74907baad5619d5794bc8 2023-02-12 00:03:10,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/2b57e0bd32fc48d79f9d8cfe28f30138 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/2b57e0bd32fc48d79f9d8cfe28f30138 2023-02-12 00:03:10,680 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/25575be1a00f41afb62e80e7d1465b9c to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/25575be1a00f41afb62e80e7d1465b9c 2023-02-12 00:03:10,681 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/9c6ea4e119114f5f94d5ac8fb2bbcc03 2023-02-12 00:03:10,682 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/12290f1a79bc4ea9bd62036ea2241a75 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/12290f1a79bc4ea9bd62036ea2241a75 2023-02-12 00:03:10,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/cf04909ec0d647c69ef39cd39f27fbc7 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/f2/cf04909ec0d647c69ef39cd39f27fbc7 2023-02-12 00:03:10,682 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/7f9cb54f309945ee8fa766c54127f698 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/7f9cb54f309945ee8fa766c54127f698 2023-02-12 00:03:10,683 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/f2/e1456f2607bb4c6e8de3613b234b50e1 2023-02-12 00:03:10,684 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/b240e0e315c44f59b6c728aa3305b016 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/f2/b240e0e315c44f59b6c728aa3305b016 2023-02-12 00:03:10,685 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/f2/fc927fee6e964d9b9e4922093be248f6 2023-02-12 00:03:10,685 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/f2/a51ecdc3da4549c68c48b8d39dc8496f 2023-02-12 00:03:10,685 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/f2/67723503961e4dafaf9a059eda90a6ab 2023-02-12 00:03:10,686 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/e160e8f31910496cb44c7c670fee83c7 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/f2/e160e8f31910496cb44c7c670fee83c7 2023-02-12 00:03:10,692 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/0c3db8b559a7479a992a44a434bf8455 2023-02-12 00:03:10,693 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa/recovered.edits/12.seqid 2023-02-12 00:03:10,693 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d/recovered.edits/12.seqid 2023-02-12 00:03:10,694 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17/recovered.edits/12.seqid 2023-02-12 00:03:10,694 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/3d5cf19a47b0c396b100b821c6c490fa 2023-02-12 00:03:10,694 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:10,695 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/d522d31bbaf37eb9d7fc875ea584af7d 2023-02-12 00:03:10,695 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a/recovered.edits/12.seqid 2023-02-12 00:03:10,695 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201/recovered.edits/12.seqid 2023-02-12 00:03:10,695 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/a5da2a37445949e268556434df103c17 2023-02-12 00:03:10,696 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a/recovered.edits/12.seqid 2023-02-12 00:03:10,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/0d38032d9a25e5f002a6df6fcb7b380a 2023-02-12 00:03:10,696 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8/recovered.edits/12.seqid 2023-02-12 00:03:10,696 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c68bcf718d90cb234b46d265064fb201 2023-02-12 00:03:10,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/7ae4f49e84554f099fd49537f261647a to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f1/7ae4f49e84554f099fd49537f261647a 2023-02-12 00:03:10,697 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/45c3486300fabc1a4e982c268e52ef6a 2023-02-12 00:03:10,697 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/005707d61c5389cc8c2b9af4dff134e8 2023-02-12 00:03:10,697 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f1, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/f2, FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/recovered.edits] 2023-02-12 00:03:10,700 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/2805fa253bea42828697cfc287fa0e32 to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/2805fa253bea42828697cfc287fa0e32 2023-02-12 00:03:10,702 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/f2/e479e945535d4e27913be98c90431aee 2023-02-12 00:03:10,704 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/recovered.edits/6.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec/recovered.edits/6.seqid 2023-02-12 00:03:10,705 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/c7e73b52318f6a98f237976687fcf4ec 2023-02-12 00:03:10,705 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/recovered.edits/12.seqid to hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/archive/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69/recovered.edits/12.seqid 2023-02-12 00:03:10,706 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/.tmp/data/default/testWithMapReduce/b9bcd0f852c8daff2adb8807a7e91f69 2023-02-12 00:03:10,706 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 00:03:10,709 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,736 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-12 00:03:10,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 00:03:10,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 00:03:10,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160190741"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,745 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 00:03:10,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7e331257d7981c1dc09bd2e19ff7df76, NAME => 'testWithMapReduce,,1676160180482.7e331257d7981c1dc09bd2e19ff7df76.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => a5da2a37445949e268556434df103c17, NAME => 'testWithMapReduce,aaa,1676160180482.a5da2a37445949e268556434df103c17.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 005707d61c5389cc8c2b9af4dff134e8, NAME => 'testWithMapReduce,d\x84\x84,1676160180482.005707d61c5389cc8c2b9af4dff134e8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c68bcf718d90cb234b46d265064fb201, NAME => 'testWithMapReduce,g\xA7\xA7,1676160180482.c68bcf718d90cb234b46d265064fb201.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 0d38032d9a25e5f002a6df6fcb7b380a, NAME => 'testWithMapReduce,j\xCA\xCA,1676160180482.0d38032d9a25e5f002a6df6fcb7b380a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 45c3486300fabc1a4e982c268e52ef6a, NAME => 'testWithMapReduce,m\xED\xED,1676160180482.45c3486300fabc1a4e982c268e52ef6a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => d522d31bbaf37eb9d7fc875ea584af7d, NAME => 'testWithMapReduce,q\x11\x10,1676160180482.d522d31bbaf37eb9d7fc875ea584af7d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3d5cf19a47b0c396b100b821c6c490fa, NAME => 'testWithMapReduce,t43,1676160180482.3d5cf19a47b0c396b100b821c6c490fa.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => b9bcd0f852c8daff2adb8807a7e91f69, NAME => 'testWithMapReduce,wWV,1676160180482.b9bcd0f852c8daff2adb8807a7e91f69.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => c7e73b52318f6a98f237976687fcf4ec, NAME => 'testWithMapReduce,zz{,1676160180482.c7e73b52318f6a98f237976687fcf4ec.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 00:03:10,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 00:03:10,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160190745"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:10,747 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 00:03:10,749 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:10,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 241 msec 2023-02-12 00:03:10,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 00:03:10,874 INFO [Listener at localhost/46331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-12 00:03:10,874 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:10,874 INFO [Listener at localhost/46331] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:10,874 DEBUG [Listener at localhost/46331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x002c6a35 to 127.0.0.1:61225 2023-02-12 00:03:10,874 DEBUG [Listener at localhost/46331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:10,874 DEBUG [Listener at localhost/46331] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:10,875 DEBUG [Listener at localhost/46331] util.JVMClusterUtil(257): Found active master hash=604258800, stopped=false 2023-02-12 00:03:10,875 INFO [Listener at localhost/46331] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:03:10,879 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:10,879 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:10,879 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:10,879 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:10,879 INFO [Listener at localhost/46331] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:10,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:10,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:10,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:10,881 DEBUG [Listener at localhost/46331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7974f79a to 127.0.0.1:61225 2023-02-12 00:03:10,881 DEBUG [Listener at localhost/46331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:10,881 INFO [Listener at localhost/46331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,44663,1676160177465' ***** 2023-02-12 00:03:10,881 INFO [Listener at localhost/46331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:10,881 INFO [Listener at localhost/46331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,40797,1676160177519' ***** 2023-02-12 00:03:10,881 INFO [Listener at localhost/46331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:10,881 INFO [RS:0;jenkins-hbase9:44663] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:10,881 INFO [RS:1;jenkins-hbase9:40797] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:10,882 INFO [RS:0;jenkins-hbase9:44663] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:10,882 INFO [RS:1;jenkins-hbase9:40797] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:10,882 INFO [RS:0;jenkins-hbase9:44663] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:10,882 INFO [RS:1;jenkins-hbase9:40797] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:10,882 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,882 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:10,882 DEBUG [RS:0;jenkins-hbase9:44663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7af20f95 to 127.0.0.1:61225 2023-02-12 00:03:10,882 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:10,882 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(3304): Received CLOSE for 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:10,882 DEBUG [RS:0;jenkins-hbase9:44663] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:10,883 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,44663,1676160177465; all regions closed. 2023-02-12 00:03:10,883 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:10,883 DEBUG [RS:1;jenkins-hbase9:40797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a04b44d to 127.0.0.1:61225 2023-02-12 00:03:10,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 6a163ef8889c8d0163ba65980a0aeb45, disabling compactions & flushes 2023-02-12 00:03:10,884 DEBUG [RS:1;jenkins-hbase9:40797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:10,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:10,884 INFO [RS:1;jenkins-hbase9:40797] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:10,884 INFO [RS:1;jenkins-hbase9:40797] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:10,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:10,884 INFO [RS:1;jenkins-hbase9:40797] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:10,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. after waiting 0 ms 2023-02-12 00:03:10,884 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:10,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:10,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 6a163ef8889c8d0163ba65980a0aeb45 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:10,885 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 00:03:10,885 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1479): Online Regions={6a163ef8889c8d0163ba65980a0aeb45=hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 00:03:10,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:10,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:10,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:10,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:10,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:10,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-12 00:03:10,887 DEBUG [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1505): Waiting on 1588230740, 6a163ef8889c8d0163ba65980a0aeb45 2023-02-12 00:03:10,889 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:10,891 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:10,900 DEBUG [RS:0;jenkins-hbase9:44663] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs 2023-02-12 00:03:10,900 INFO [RS:0;jenkins-hbase9:44663] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44663%2C1676160177465:(num 1676160179935) 2023-02-12 00:03:10,900 DEBUG [RS:0;jenkins-hbase9:44663] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:10,900 INFO [RS:0;jenkins-hbase9:44663] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:10,906 INFO [RS:0;jenkins-hbase9:44663] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:10,906 INFO [RS:0;jenkins-hbase9:44663] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:10,906 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:10,906 INFO [RS:0;jenkins-hbase9:44663] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:10,907 INFO [RS:0;jenkins-hbase9:44663] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:10,908 INFO [RS:0;jenkins-hbase9:44663] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44663 2023-02-12 00:03:10,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/.tmp/info/4350f15c4f1f4a6b9c659206e283352c 2023-02-12 00:03:10,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/info/3a1c22346cde41edaaf0703482e79fc7 2023-02-12 00:03:10,917 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:10,917 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,917 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:10,918 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44663,1676160177465 2023-02-12 00:03:10,918 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d8a7611 rejected from java.util.concurrent.ThreadPoolExecutor@9b5e378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:10,918 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:10,918 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23d5a07c rejected from java.util.concurrent.ThreadPoolExecutor@9b5e378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:10,918 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44663,1676160177465] 2023-02-12 00:03:10,918 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44663,1676160177465; numProcessing=1 2023-02-12 00:03:10,920 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44663,1676160177465 already deleted, retry=false 2023-02-12 00:03:10,920 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44663,1676160177465 expired; onlineServers=1 2023-02-12 00:03:10,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/.tmp/info/4350f15c4f1f4a6b9c659206e283352c as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/info/4350f15c4f1f4a6b9c659206e283352c 2023-02-12 00:03:10,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a1c22346cde41edaaf0703482e79fc7 2023-02-12 00:03:10,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/info/4350f15c4f1f4a6b9c659206e283352c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:10,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6a163ef8889c8d0163ba65980a0aeb45 in 48ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:10,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/rep_barrier/518780dbd8434af48ec0664d17c0d967 2023-02-12 00:03:10,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/namespace/6a163ef8889c8d0163ba65980a0aeb45/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:10,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 6a163ef8889c8d0163ba65980a0aeb45: Waiting for close lock at 1676160190883Running coprocessor pre-close hooks at 1676160190883Disabling compacts and flushes for region at 1676160190883Disabling writes for close at 1676160190884 (+1 ms)Obtaining lock to block concurrent updates at 1676160190884Preparing flush snapshotting stores in 6a163ef8889c8d0163ba65980a0aeb45 at 1676160190884Finished memstore snapshotting hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160190885 (+1 ms)Flushing stores of hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. at 1676160190886 (+1 ms)Flushing 6a163ef8889c8d0163ba65980a0aeb45/info: creating writer at 1676160190886Flushing 6a163ef8889c8d0163ba65980a0aeb45/info: appending metadata at 1676160190891 (+5 ms)Flushing 6a163ef8889c8d0163ba65980a0aeb45/info: closing flushed file at 1676160190891Flushing 6a163ef8889c8d0163ba65980a0aeb45/info: reopening flushed file at 1676160190923 (+32 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6a163ef8889c8d0163ba65980a0aeb45 in 48ms, sequenceid=6, compaction requested=false at 1676160190932 (+9 ms)Writing region close event to WAL at 1676160190940 (+8 ms)Running coprocessor post-close hooks at 1676160190948 (+8 ms)Closed at 1676160190951 (+3 ms) 2023-02-12 00:03:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160179588.6a163ef8889c8d0163ba65980a0aeb45. 2023-02-12 00:03:10,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 518780dbd8434af48ec0664d17c0d967 2023-02-12 00:03:10,970 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/table/fe381897b8b64a11b22901e35e8df672 2023-02-12 00:03:10,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe381897b8b64a11b22901e35e8df672 2023-02-12 00:03:10,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/info/3a1c22346cde41edaaf0703482e79fc7 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/info/3a1c22346cde41edaaf0703482e79fc7 2023-02-12 00:03:10,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a1c22346cde41edaaf0703482e79fc7 2023-02-12 00:03:10,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/info/3a1c22346cde41edaaf0703482e79fc7, entries=30, sequenceid=57, filesize=7.9 K 2023-02-12 00:03:10,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/rep_barrier/518780dbd8434af48ec0664d17c0d967 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/rep_barrier/518780dbd8434af48ec0664d17c0d967 2023-02-12 00:03:10,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 518780dbd8434af48ec0664d17c0d967 2023-02-12 00:03:10,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/rep_barrier/518780dbd8434af48ec0664d17c0d967, entries=10, sequenceid=57, filesize=5.9 K 2023-02-12 00:03:10,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/.tmp/table/fe381897b8b64a11b22901e35e8df672 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/table/fe381897b8b64a11b22901e35e8df672 2023-02-12 00:03:10,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe381897b8b64a11b22901e35e8df672 2023-02-12 00:03:10,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/table/fe381897b8b64a11b22901e35e8df672, entries=13, sequenceid=57, filesize=5.9 K 2023-02-12 00:03:10,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 114ms, sequenceid=57, compaction requested=false 2023-02-12 00:03:11,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 00:03:11,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:11,012 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:11,012 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160190885Running coprocessor pre-close hooks at 1676160190885Disabling compacts and flushes for region at 1676160190885Disabling writes for close at 1676160190885Obtaining lock to block concurrent updates at 1676160190885Preparing flush snapshotting stores in 1588230740 at 1676160190885Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676160190886 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676160190886Flushing 1588230740/info: creating writer at 1676160190886Flushing 1588230740/info: appending metadata at 1676160190894 (+8 ms)Flushing 1588230740/info: closing flushed file at 1676160190894Flushing 1588230740/rep_barrier: creating writer at 1676160190923 (+29 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160190926 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160190926Flushing 1588230740/table: creating writer at 1676160190954 (+28 ms)Flushing 1588230740/table: appending metadata at 1676160190957 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676160190957Flushing 1588230740/info: reopening flushed file at 1676160190977 (+20 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160190986 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1676160190993 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 114ms, sequenceid=57, compaction requested=false at 1676160190999 (+6 ms)Writing region close event to WAL at 1676160191008 (+9 ms)Running coprocessor post-close hooks at 1676160191011 (+3 ms)Closed at 1676160191012 (+1 ms) 2023-02-12 00:03:11,012 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:11,079 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,079 INFO [RS:0;jenkins-hbase9:44663] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,44663,1676160177465; zookeeper connection closed. 2023-02-12 00:03:11,079 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bb9f214 rejected from java.util.concurrent.ThreadPoolExecutor@9b5e378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,080 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10045d76ced0001, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,080 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@26661b3b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@26661b3b 2023-02-12 00:03:11,080 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@224010ca rejected from java.util.concurrent.ThreadPoolExecutor@9b5e378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,087 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,40797,1676160177519; all regions closed. 2023-02-12 00:03:11,094 DEBUG [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs 2023-02-12 00:03:11,094 INFO [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40797%2C1676160177519.meta:.meta(num 1676160179283) 2023-02-12 00:03:11,100 DEBUG [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/oldWALs 2023-02-12 00:03:11,100 INFO [RS:1;jenkins-hbase9:40797] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40797%2C1676160177519:(num 1676160179935) 2023-02-12 00:03:11,100 DEBUG [RS:1;jenkins-hbase9:40797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:11,100 INFO [RS:1;jenkins-hbase9:40797] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:11,100 INFO [RS:1;jenkins-hbase9:40797] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:11,101 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:11,102 INFO [RS:1;jenkins-hbase9:40797] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40797 2023-02-12 00:03:11,106 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:11,106 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40797,1676160177519 2023-02-12 00:03:11,106 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ec98cd8 rejected from java.util.concurrent.ThreadPoolExecutor@2af60dd9[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,106 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,40797,1676160177519] 2023-02-12 00:03:11,106 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,40797,1676160177519; numProcessing=2 2023-02-12 00:03:11,108 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,40797,1676160177519 already deleted, retry=false 2023-02-12 00:03:11,108 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,40797,1676160177519 expired; onlineServers=0 2023-02-12 00:03:11,108 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,32789,1676160176275' ***** 2023-02-12 00:03:11,108 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:11,108 DEBUG [M:0;jenkins-hbase9:32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65394bcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:11,109 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,32789,1676160176275 2023-02-12 00:03:11,109 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,32789,1676160176275; all regions closed. 2023-02-12 00:03:11,109 DEBUG [M:0;jenkins-hbase9:32789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:11,109 DEBUG [M:0;jenkins-hbase9:32789] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:11,110 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:11,110 DEBUG [M:0;jenkins-hbase9:32789] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:11,110 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160178686] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160178686,5,FailOnTimeoutGroup] 2023-02-12 00:03:11,110 INFO [M:0;jenkins-hbase9:32789] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:11,110 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160178683] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160178683,5,FailOnTimeoutGroup] 2023-02-12 00:03:11,111 INFO [M:0;jenkins-hbase9:32789] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:11,111 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:11,111 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:11,112 INFO [M:0;jenkins-hbase9:32789] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:11,112 DEBUG [M:0;jenkins-hbase9:32789] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:11,112 INFO [M:0;jenkins-hbase9:32789] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:11,112 ERROR [M:0;jenkins-hbase9:32789] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-12 00:03:11,113 INFO [M:0;jenkins-hbase9:32789] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:11,113 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:11,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:11,114 DEBUG [M:0;jenkins-hbase9:32789] zookeeper.ZKUtil(398): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:11,114 WARN [M:0;jenkins-hbase9:32789] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:11,114 INFO [M:0;jenkins-hbase9:32789] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:11,114 INFO [M:0;jenkins-hbase9:32789] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:11,115 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:11,115 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:11,115 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:11,115 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:11,115 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:11,115 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-12 00:03:11,133 INFO [M:0;jenkins-hbase9:32789] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f1a52fb044fe489e8d22b5db977322a9 2023-02-12 00:03:11,139 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f1a52fb044fe489e8d22b5db977322a9 as hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f1a52fb044fe489e8d22b5db977322a9 2023-02-12 00:03:11,145 INFO [M:0;jenkins-hbase9:32789] regionserver.HStore(1080): Added hdfs://localhost:43363/user/jenkins/test-data/3b9b02a2-d5c2-ac56-359d-a8b895462526/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f1a52fb044fe489e8d22b5db977322a9, entries=53, sequenceid=357, filesize=10.4 K 2023-02-12 00:03:11,146 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false 2023-02-12 00:03:11,147 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:11,147 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160191114Disabling compacts and flushes for region at 1676160191114Disabling writes for close at 1676160191115 (+1 ms)Obtaining lock to block concurrent updates at 1676160191115Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160191115Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163075, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1676160191115Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160191116 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160191116Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160191120 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160191120Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160191140 (+20 ms)Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false at 1676160191146 (+6 ms)Writing region close event to WAL at 1676160191147 (+1 ms)Closed at 1676160191147 2023-02-12 00:03:11,151 INFO [M:0;jenkins-hbase9:32789] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:11,151 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:11,151 INFO [M:0;jenkins-hbase9:32789] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:32789 2023-02-12 00:03:11,155 DEBUG [M:0;jenkins-hbase9:32789] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,32789,1676160176275 already deleted, retry=false 2023-02-12 00:03:11,482 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,482 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,32789,1676160176275; zookeeper connection closed. 2023-02-12 00:03:11,482 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@445d9228 rejected from java.util.concurrent.ThreadPoolExecutor@77dcaaee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,482 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): master:32789-0x10045d76ced0000, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,482 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5625d8f0 rejected from java.util.concurrent.ThreadPoolExecutor@77dcaaee[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,582 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,582 INFO [RS:1;jenkins-hbase9:40797] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,40797,1676160177519; zookeeper connection closed. 2023-02-12 00:03:11,582 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c1c9e9a rejected from java.util.concurrent.ThreadPoolExecutor@2af60dd9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,582 DEBUG [Listener at localhost/46331-EventThread] zookeeper.ZKWatcher(600): regionserver:40797-0x10045d76ced0002, quorum=127.0.0.1:61225, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:11,582 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@32b708d4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@32b708d4 2023-02-12 00:03:11,582 ERROR [Listener at localhost/46331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44d32c4b rejected from java.util.concurrent.ThreadPoolExecutor@2af60dd9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:11,583 INFO [Listener at localhost/46331] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:11,584 WARN [Listener at localhost/46331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:11,589 INFO [Listener at localhost/46331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:11,695 WARN [BP-54532356-172.31.2.10-1676160172561 heartbeating to localhost/127.0.0.1:43363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:11,695 WARN [BP-54532356-172.31.2.10-1676160172561 heartbeating to localhost/127.0.0.1:43363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-54532356-172.31.2.10-1676160172561 (Datanode Uuid 3c6fcada-66a7-45f9-b2da-be6c7ad64d70) service to localhost/127.0.0.1:43363 2023-02-12 00:03:11,697 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/dfs/data/data3/current/BP-54532356-172.31.2.10-1676160172561] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:11,698 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/dfs/data/data4/current/BP-54532356-172.31.2.10-1676160172561] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:11,700 WARN [Listener at localhost/46331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:11,708 INFO [Listener at localhost/46331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:11,811 WARN [BP-54532356-172.31.2.10-1676160172561 heartbeating to localhost/127.0.0.1:43363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:11,812 WARN [BP-54532356-172.31.2.10-1676160172561 heartbeating to localhost/127.0.0.1:43363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-54532356-172.31.2.10-1676160172561 (Datanode Uuid ae640952-ae64-493d-adc1-e156ab96f412) service to localhost/127.0.0.1:43363 2023-02-12 00:03:11,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/dfs/data/data1/current/BP-54532356-172.31.2.10-1676160172561] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:11,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/cluster_bb3611a3-74e3-b9a4-9416-7788aa62c74b/dfs/data/data2/current/BP-54532356-172.31.2.10-1676160172561] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:11,850 INFO [Listener at localhost/46331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:11,971 INFO [Listener at localhost/46331] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:12,050 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:12,072 INFO [Listener at localhost/46331] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@41122616 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,32789,1676160176275)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:43363 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: Listener at localhost/46331 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43363 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:43363 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:43363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:43363 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:43363 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:43363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=530 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 163) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9832 (was 10870) 2023-02-12 00:03:12,086 INFO [Listener at localhost/46331] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=530, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=167, AvailableMemoryMB=9832 2023-02-12 00:03:12,097 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.log.dir so I do NOT create it in target/test-data/4a488621-326e-9394-0708-06868571e0d1 2023-02-12 00:03:12,097 WARN [Listener at localhost/46331] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:12,097 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.tmp.dir so I do NOT create it in target/test-data/4a488621-326e-9394-0708-06868571e0d1 2023-02-12 00:03:12,098 WARN [Listener at localhost/46331] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba2d64e6-df1e-9745-1cd7-f4b5b94b774a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:12,098 DEBUG [Listener at localhost/46331] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646, deleteOnExit=true 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/test.cache.data in system properties and HBase conf 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:12,098 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:12,099 DEBUG [Listener at localhost/46331] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:12,099 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:12,100 INFO [Listener at localhost/46331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:12,105 WARN [Listener at localhost/46331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:12,105 WARN [Listener at localhost/46331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:12,151 WARN [Listener at localhost/46331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:12,154 INFO [Listener at localhost/46331] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:12,162 INFO [Listener at localhost/46331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/java.io.tmpdir/Jetty_localhost_43923_hdfs____.sk3egr/webapp 2023-02-12 00:03:12,283 INFO [Listener at localhost/46331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43923 2023-02-12 00:03:12,288 WARN [Listener at localhost/46331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:12,288 WARN [Listener at localhost/46331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:12,338 WARN [Listener at localhost/38083] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:12,367 WARN [Listener at localhost/38083] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:12,370 WARN [Listener at localhost/38083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:12,371 INFO [Listener at localhost/38083] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:12,377 INFO [Listener at localhost/38083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/java.io.tmpdir/Jetty_localhost_40467_datanode____sqhgf4/webapp 2023-02-12 00:03:12,487 INFO [Listener at localhost/38083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40467 2023-02-12 00:03:12,495 WARN [Listener at localhost/44799] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:12,514 WARN [Listener at localhost/44799] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:12,516 WARN [Listener at localhost/44799] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:12,517 INFO [Listener at localhost/44799] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:12,523 INFO [Listener at localhost/44799] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/java.io.tmpdir/Jetty_localhost_37021_datanode____.ivz572/webapp 2023-02-12 00:03:12,624 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ded0da0795c329f: Processing first storage report for DS-a86afc62-b32a-4d14-aea0-9127a2aa858e from datanode 061b379f-09c7-4e59-b2f5-fa77d89ab6d2 2023-02-12 00:03:12,624 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ded0da0795c329f: from storage DS-a86afc62-b32a-4d14-aea0-9127a2aa858e node DatanodeRegistration(127.0.0.1:38891, datanodeUuid=061b379f-09c7-4e59-b2f5-fa77d89ab6d2, infoPort=37293, infoSecurePort=0, ipcPort=44799, storageInfo=lv=-57;cid=testClusterID;nsid=567610718;c=1676160192107), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:12,624 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ded0da0795c329f: Processing first storage report for DS-e3829e5e-a5ea-4fde-9cd2-95e6fc824ddd from datanode 061b379f-09c7-4e59-b2f5-fa77d89ab6d2 2023-02-12 00:03:12,624 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ded0da0795c329f: from storage DS-e3829e5e-a5ea-4fde-9cd2-95e6fc824ddd node DatanodeRegistration(127.0.0.1:38891, datanodeUuid=061b379f-09c7-4e59-b2f5-fa77d89ab6d2, infoPort=37293, infoSecurePort=0, ipcPort=44799, storageInfo=lv=-57;cid=testClusterID;nsid=567610718;c=1676160192107), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:12,636 INFO [Listener at localhost/44799] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37021 2023-02-12 00:03:12,653 WARN [Listener at localhost/42847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:12,765 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0d6634e23109cd9: Processing first storage report for DS-4d89405e-6016-419e-a75c-8524ca8bd0f7 from datanode c54198ce-18d8-48d9-a878-b51b1d4f1fab 2023-02-12 00:03:12,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0d6634e23109cd9: from storage DS-4d89405e-6016-419e-a75c-8524ca8bd0f7 node DatanodeRegistration(127.0.0.1:36163, datanodeUuid=c54198ce-18d8-48d9-a878-b51b1d4f1fab, infoPort=42617, infoSecurePort=0, ipcPort=42847, storageInfo=lv=-57;cid=testClusterID;nsid=567610718;c=1676160192107), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:12,766 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0d6634e23109cd9: Processing first storage report for DS-c8c02f69-7f53-432d-863e-f0aa4a15364f from datanode c54198ce-18d8-48d9-a878-b51b1d4f1fab 2023-02-12 00:03:12,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0d6634e23109cd9: from storage DS-c8c02f69-7f53-432d-863e-f0aa4a15364f node DatanodeRegistration(127.0.0.1:36163, datanodeUuid=c54198ce-18d8-48d9-a878-b51b1d4f1fab, infoPort=42617, infoSecurePort=0, ipcPort=42847, storageInfo=lv=-57;cid=testClusterID;nsid=567610718;c=1676160192107), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:12,862 DEBUG [Listener at localhost/42847] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1 2023-02-12 00:03:12,874 INFO [Listener at localhost/42847] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/zookeeper_0, clientPort=55516, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:12,876 INFO [Listener at localhost/42847] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55516 2023-02-12 00:03:12,877 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,878 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,919 INFO [Listener at localhost/42847] util.FSUtils(479): Created version file at hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d with version=8 2023-02-12 00:03:12,919 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,920 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,922 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/hbase-staging 2023-02-12 00:03:12,924 INFO [Listener at localhost/42847] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:12,925 INFO [Listener at localhost/42847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:12,928 INFO [Listener at localhost/42847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40739 2023-02-12 00:03:12,929 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,930 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:12,931 INFO [Listener at localhost/42847] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40739 connecting to ZooKeeper ensemble=127.0.0.1:55516 2023-02-12 00:03:12,950 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:407390x0, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:12,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40739-0x10045d7b1560000 connected 2023-02-12 00:03:12,974 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:12,974 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:12,975 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:12,979 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40739 2023-02-12 00:03:12,979 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40739 2023-02-12 00:03:12,984 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40739 2023-02-12 00:03:12,987 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40739 2023-02-12 00:03:12,991 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40739 2023-02-12 00:03:12,991 INFO [Listener at localhost/42847] master.HMaster(439): hbase.rootdir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d, hbase.cluster.distributed=false 2023-02-12 00:03:13,014 INFO [Listener at localhost/42847] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:13,015 INFO [Listener at localhost/42847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:13,017 INFO [Listener at localhost/42847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43729 2023-02-12 00:03:13,018 INFO [Listener at localhost/42847] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:13,021 DEBUG [Listener at localhost/42847] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:13,022 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:13,023 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:13,024 INFO [Listener at localhost/42847] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43729 connecting to ZooKeeper ensemble=127.0.0.1:55516 2023-02-12 00:03:13,027 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:437290x0, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:13,028 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:437290x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:13,029 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:437290x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:13,029 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:437290x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:13,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43729-0x10045d7b1560001 connected 2023-02-12 00:03:13,039 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43729 2023-02-12 00:03:13,039 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43729 2023-02-12 00:03:13,039 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43729 2023-02-12 00:03:13,042 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43729 2023-02-12 00:03:13,043 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43729 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:13,061 INFO [Listener at localhost/42847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:13,062 INFO [Listener at localhost/42847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:13,064 INFO [Listener at localhost/42847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43357 2023-02-12 00:03:13,064 INFO [Listener at localhost/42847] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:13,065 DEBUG [Listener at localhost/42847] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:13,066 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:13,066 INFO [Listener at localhost/42847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:13,067 INFO [Listener at localhost/42847] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43357 connecting to ZooKeeper ensemble=127.0.0.1:55516 2023-02-12 00:03:13,071 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:433570x0, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:13,072 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:433570x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:13,072 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:433570x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:13,073 DEBUG [Listener at localhost/42847] zookeeper.ZKUtil(164): regionserver:433570x0, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:13,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43357-0x10045d7b1560002 connected 2023-02-12 00:03:13,083 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43357 2023-02-12 00:03:13,084 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43357 2023-02-12 00:03:13,084 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43357 2023-02-12 00:03:13,085 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43357 2023-02-12 00:03:13,087 DEBUG [Listener at localhost/42847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43357 2023-02-12 00:03:13,088 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,090 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:13,091 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,094 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:13,094 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:13,094 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:13,094 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,096 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:13,097 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,40739,1676160192924 from backup master directory 2023-02-12 00:03:13,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:13,099 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,099 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:13,099 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:13,099 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,124 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/hbase.id with ID: 06f0afa9-12fa-432c-ab27-15173c202eef 2023-02-12 00:03:13,137 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:13,140 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2d2d6d4b to 127.0.0.1:55516 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:13,162 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7987e4ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:13,162 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:13,163 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:13,163 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:13,165 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store-tmp 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:13,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:13,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:13,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160193179Disabling compacts and flushes for region at 1676160193179Disabling writes for close at 1676160193179Writing region close event to WAL at 1676160193179Closed at 1676160193179 2023-02-12 00:03:13,180 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/WALs/jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40739%2C1676160192924, suffix=, logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/WALs/jenkins-hbase9.apache.org,40739,1676160192924, archiveDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:13,202 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK] 2023-02-12 00:03:13,203 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK] 2023-02-12 00:03:13,206 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/WALs/jenkins-hbase9.apache.org,40739,1676160192924/jenkins-hbase9.apache.org%2C40739%2C1676160192924.1676160193183 2023-02-12 00:03:13,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK], DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK]] 2023-02-12 00:03:13,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:13,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:13,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,208 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,210 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:13,210 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:13,211 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,211 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,212 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,215 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:13,218 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:13,219 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62517991, jitterRate=-0.06840933859348297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:13,219 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160193207Initializing all the Stores at 1676160193208 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160193208Cleaning up temporary data from old regions at 1676160193212 (+4 ms)Cleaning up detritus from prior splits at 1676160193213 (+1 ms)Region opened successfully at 1676160193219 (+6 ms) 2023-02-12 00:03:13,220 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:13,221 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:13,221 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:13,221 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:13,222 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:13,222 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:13,222 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:13,224 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:13,226 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:13,242 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:13,242 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:13,243 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:13,243 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:13,243 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:13,246 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,247 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:13,247 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:13,248 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:13,250 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:13,250 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:13,250 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:13,250 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,40739,1676160192924, sessionid=0x10045d7b1560000, setting cluster-up flag (Was=false) 2023-02-12 00:03:13,255 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,260 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:13,261 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,269 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,274 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:13,275 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:13,276 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/.tmp 2023-02-12 00:03:13,279 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:13,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160223284 2023-02-12 00:03:13,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:13,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:13,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:13,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:13,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:13,286 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160193286,5,FailOnTimeoutGroup] 2023-02-12 00:03:13,287 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:13,287 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:13,288 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:13,289 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160193286,5,FailOnTimeoutGroup] 2023-02-12 00:03:13,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:13,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,297 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(952): ClusterId : 06f0afa9-12fa-432c-ab27-15173c202eef 2023-02-12 00:03:13,297 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(952): ClusterId : 06f0afa9-12fa-432c-ab27-15173c202eef 2023-02-12 00:03:13,297 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:13,297 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:13,301 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:13,301 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:13,301 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:13,301 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:13,304 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:13,305 DEBUG [RS:1;jenkins-hbase9:43357] zookeeper.ReadOnlyZKClient(139): Connect 0x45ac765f to 127.0.0.1:55516 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:13,307 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:13,312 DEBUG [RS:0;jenkins-hbase9:43729] zookeeper.ReadOnlyZKClient(139): Connect 0x5143c77e to 127.0.0.1:55516 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:13,322 DEBUG [RS:0;jenkins-hbase9:43729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f843326, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:13,323 DEBUG [RS:0;jenkins-hbase9:43729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bbbac0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:13,326 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:13,326 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:13,327 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d 2023-02-12 00:03:13,327 DEBUG [RS:1;jenkins-hbase9:43357] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b6b809a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:13,327 DEBUG [RS:1;jenkins-hbase9:43357] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f541d2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:13,336 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:43357 2023-02-12 00:03:13,336 INFO [RS:1;jenkins-hbase9:43357] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:13,336 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:43729 2023-02-12 00:03:13,336 INFO [RS:1;jenkins-hbase9:43357] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:13,336 INFO [RS:0;jenkins-hbase9:43729] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:13,336 INFO [RS:0;jenkins-hbase9:43729] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:13,336 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:13,336 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:13,337 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,40739,1676160192924 with isa=jenkins-hbase9.apache.org/172.31.2.10:43357, startcode=1676160193060 2023-02-12 00:03:13,338 DEBUG [RS:1;jenkins-hbase9:43357] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:13,339 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,40739,1676160192924 with isa=jenkins-hbase9.apache.org/172.31.2.10:43729, startcode=1676160193014 2023-02-12 00:03:13,340 DEBUG [RS:0;jenkins-hbase9:43729] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:13,344 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:13,345 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44935, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:13,346 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43799, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:13,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40739] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,347 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:13,348 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d 2023-02-12 00:03:13,348 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38083 2023-02-12 00:03:13,348 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:13,348 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d 2023-02-12 00:03:13,349 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38083 2023-02-12 00:03:13,349 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:13,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/info 2023-02-12 00:03:13,350 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:13,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:13,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:13,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:13,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:13,354 DEBUG [RS:1;jenkins-hbase9:43357] zookeeper.ZKUtil(162): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,355 WARN [RS:1;jenkins-hbase9:43357] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:13,355 INFO [RS:1;jenkins-hbase9:43357] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:13,355 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,355 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43357,1676160193060] 2023-02-12 00:03:13,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,355 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43729,1676160193014] 2023-02-12 00:03:13,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:13,356 DEBUG [RS:0;jenkins-hbase9:43729] zookeeper.ZKUtil(162): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,356 WARN [RS:0;jenkins-hbase9:43729] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:13,356 INFO [RS:0;jenkins-hbase9:43729] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:13,356 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/table 2023-02-12 00:03:13,360 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:13,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,368 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740 2023-02-12 00:03:13,368 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740 2023-02-12 00:03:13,370 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:13,372 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:13,384 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:13,385 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59937501, jitterRate=-0.10686163604259491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:13,385 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160193344Initializing all the Stores at 1676160193346 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160193346Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160193347 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160193347Cleaning up temporary data from old regions at 1676160193369 (+22 ms)Cleaning up detritus from prior splits at 1676160193370 (+1 ms)Region opened successfully at 1676160193385 (+15 ms) 2023-02-12 00:03:13,385 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:13,385 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:13,385 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:13,385 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:13,385 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:13,386 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:13,386 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160193385Disabling compacts and flushes for region at 1676160193385Disabling writes for close at 1676160193385Writing region close event to WAL at 1676160193386 (+1 ms)Closed at 1676160193386 2023-02-12 00:03:13,387 DEBUG [RS:1;jenkins-hbase9:43357] zookeeper.ZKUtil(162): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,387 DEBUG [RS:1;jenkins-hbase9:43357] zookeeper.ZKUtil(162): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,387 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:13,388 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:13,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:13,389 DEBUG [RS:0;jenkins-hbase9:43729] zookeeper.ZKUtil(162): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,389 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:13,390 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:13,390 DEBUG [RS:0;jenkins-hbase9:43729] zookeeper.ZKUtil(162): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,390 INFO [RS:1;jenkins-hbase9:43357] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:13,391 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:13,392 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:13,393 INFO [RS:0;jenkins-hbase9:43729] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:13,393 INFO [RS:1;jenkins-hbase9:43357] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:13,401 INFO [RS:1;jenkins-hbase9:43357] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:13,401 INFO [RS:0;jenkins-hbase9:43729] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:13,401 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,402 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:13,408 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,408 INFO [RS:0;jenkins-hbase9:43729] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:13,408 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,408 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,408 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,408 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,408 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:13,408 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,409 DEBUG [RS:1;jenkins-hbase9:43357] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,410 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,410 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,410 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,410 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,411 DEBUG [RS:0;jenkins-hbase9:43729] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:13,412 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,412 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,412 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,426 INFO [RS:1;jenkins-hbase9:43357] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:13,426 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43357,1676160193060-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,437 INFO [RS:0;jenkins-hbase9:43729] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:13,437 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43729,1676160193014-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,439 INFO [RS:1;jenkins-hbase9:43357] regionserver.Replication(203): jenkins-hbase9.apache.org,43357,1676160193060 started 2023-02-12 00:03:13,439 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,43357,1676160193060, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43357, sessionid=0x10045d7b1560002 2023-02-12 00:03:13,439 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:13,439 DEBUG [RS:1;jenkins-hbase9:43357] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43357,1676160193060' 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,440 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43357,1676160193060' 2023-02-12 00:03:13,441 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:13,441 DEBUG [RS:1;jenkins-hbase9:43357] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:13,441 DEBUG [RS:1;jenkins-hbase9:43357] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:13,441 INFO [RS:1;jenkins-hbase9:43357] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:13,441 INFO [RS:1;jenkins-hbase9:43357] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:13,450 INFO [RS:0;jenkins-hbase9:43729] regionserver.Replication(203): jenkins-hbase9.apache.org,43729,1676160193014 started 2023-02-12 00:03:13,450 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,43729,1676160193014, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43729, sessionid=0x10045d7b1560001 2023-02-12 00:03:13,450 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:13,450 DEBUG [RS:0;jenkins-hbase9:43729] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,450 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43729,1676160193014' 2023-02-12 00:03:13,450 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43729,1676160193014' 2023-02-12 00:03:13,451 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:13,452 DEBUG [RS:0;jenkins-hbase9:43729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:13,452 DEBUG [RS:0;jenkins-hbase9:43729] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:13,452 INFO [RS:0;jenkins-hbase9:43729] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:13,452 INFO [RS:0;jenkins-hbase9:43729] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:13,541 DEBUG [jenkins-hbase9:40739] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:13,541 DEBUG [jenkins-hbase9:40739] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:13,543 DEBUG [jenkins-hbase9:40739] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:13,543 DEBUG [jenkins-hbase9:40739] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:13,543 DEBUG [jenkins-hbase9:40739] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:13,544 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43357,1676160193060, state=OPENING 2023-02-12 00:03:13,546 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:13,547 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:13,547 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:13,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:13,702 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:13,702 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:13,706 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:13,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:13,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:13,719 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43357%2C1676160193060.meta, suffix=.meta, logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43357,1676160193060, archiveDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs, maxLogs=32 2023-02-12 00:03:13,743 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK] 2023-02-12 00:03:13,743 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK] 2023-02-12 00:03:13,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43357,1676160193060/jenkins-hbase9.apache.org%2C43357%2C1676160193060.meta.1676160193721.meta 2023-02-12 00:03:13,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK], DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK]] 2023-02-12 00:03:13,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:13,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:13,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:13,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:13,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:13,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:13,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:13,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:13,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:13,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/info 2023-02-12 00:03:13,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/info 2023-02-12 00:03:13,753 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:13,753 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:13,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:13,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:13,755 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:13,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:13,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/table 2023-02-12 00:03:13,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/table 2023-02-12 00:03:13,757 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:13,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:13,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740 2023-02-12 00:03:13,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740 2023-02-12 00:03:13,762 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:13,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:13,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60633352, jitterRate=-0.09649264812469482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:13,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160193749Writing region info on filesystem at 1676160193749Initializing all the Stores at 1676160193750 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160193750Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160193751 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160193751Cleaning up temporary data from old regions at 1676160193761 (+10 ms)Cleaning up detritus from prior splits at 1676160193762 (+1 ms)Running coprocessor post-open hooks at 1676160193765 (+3 ms)Region opened successfully at 1676160193765 2023-02-12 00:03:13,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160193702 2023-02-12 00:03:13,776 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:13,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:13,777 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43357,1676160193060, state=OPEN 2023-02-12 00:03:13,778 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:13,779 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:13,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:13,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43357,1676160193060 in 231 msec 2023-02-12 00:03:13,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:13,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 393 msec 2023-02-12 00:03:13,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 506 msec 2023-02-12 00:03:13,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160193091, completionTime=-1 2023-02-12 00:03:13,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:13,785 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:13,795 DEBUG [hconnection-0x160377f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:13,797 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:13,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:13,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160253800 2023-02-12 00:03:13,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160313800 2023-02-12 00:03:13,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 15 msec 2023-02-12 00:03:13,810 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40739,1676160192924-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40739,1676160192924-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40739,1676160192924-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:40739, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:13,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:13,812 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:13,814 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:13,815 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:13,816 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:13,817 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:13,818 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe empty. 2023-02-12 00:03:13,819 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:13,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:13,832 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:13,855 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00b19ae01701bbe03d465ebfa714e2fe, NAME => 'hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 00b19ae01701bbe03d465ebfa714e2fe, disabling compactions & flushes 2023-02-12 00:03:13,878 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. after waiting 0 ms 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:13,878 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:13,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 00b19ae01701bbe03d465ebfa714e2fe: Waiting for close lock at 1676160193878Disabling compacts and flushes for region at 1676160193878Disabling writes for close at 1676160193878Writing region close event to WAL at 1676160193878Closed at 1676160193878 2023-02-12 00:03:13,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:13,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160193882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160193882"}]},"ts":"1676160193882"} 2023-02-12 00:03:13,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:13,886 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:13,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160193887"}]},"ts":"1676160193887"} 2023-02-12 00:03:13,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:13,892 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:13,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:13,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:13,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:13,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=00b19ae01701bbe03d465ebfa714e2fe, ASSIGN}] 2023-02-12 00:03:13,895 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=00b19ae01701bbe03d465ebfa714e2fe, ASSIGN 2023-02-12 00:03:13,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=00b19ae01701bbe03d465ebfa714e2fe, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,047 INFO [jenkins-hbase9:40739] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:14,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=00b19ae01701bbe03d465ebfa714e2fe, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:14,048 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160194048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160194048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160194048"}]},"ts":"1676160194048"} 2023-02-12 00:03:14,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 00b19ae01701bbe03d465ebfa714e2fe, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:14,205 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:14,205 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:14,209 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:14,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:14,219 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43729%2C1676160193014, suffix=, logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43729,1676160193014, archiveDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs, maxLogs=32 2023-02-12 00:03:14,242 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK] 2023-02-12 00:03:14,242 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK] 2023-02-12 00:03:14,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43729,1676160193014/jenkins-hbase9.apache.org%2C43729%2C1676160193014.1676160194221 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK]] 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00b19ae01701bbe03d465ebfa714e2fe, NAME => 'hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,263 INFO [StoreOpener-00b19ae01701bbe03d465ebfa714e2fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,265 DEBUG [StoreOpener-00b19ae01701bbe03d465ebfa714e2fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/info 2023-02-12 00:03:14,265 DEBUG [StoreOpener-00b19ae01701bbe03d465ebfa714e2fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/info 2023-02-12 00:03:14,265 INFO [StoreOpener-00b19ae01701bbe03d465ebfa714e2fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00b19ae01701bbe03d465ebfa714e2fe columnFamilyName info 2023-02-12 00:03:14,266 INFO [StoreOpener-00b19ae01701bbe03d465ebfa714e2fe-1] regionserver.HStore(310): Store=00b19ae01701bbe03d465ebfa714e2fe/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:14,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:14,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:14,282 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 00b19ae01701bbe03d465ebfa714e2fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73427246, jitterRate=0.09415122866630554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:14,283 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 00b19ae01701bbe03d465ebfa714e2fe: Running coprocessor pre-open hook at 1676160194256Writing region info on filesystem at 1676160194256Initializing all the Stores at 1676160194256Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160194257 (+1 ms)Cleaning up temporary data from old regions at 1676160194268 (+11 ms)Cleaning up detritus from prior splits at 1676160194268Running coprocessor post-open hooks at 1676160194282 (+14 ms)Region opened successfully at 1676160194282 2023-02-12 00:03:14,284 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe., pid=6, masterSystemTime=1676160194205 2023-02-12 00:03:14,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:14,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:14,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=00b19ae01701bbe03d465ebfa714e2fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:14,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160194290"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160194290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160194290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160194290"}]},"ts":"1676160194290"} 2023-02-12 00:03:14,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:14,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 00b19ae01701bbe03d465ebfa714e2fe, server=jenkins-hbase9.apache.org,43729,1676160193014 in 241 msec 2023-02-12 00:03:14,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:14,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=00b19ae01701bbe03d465ebfa714e2fe, ASSIGN in 402 msec 2023-02-12 00:03:14,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:14,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160194299"}]},"ts":"1676160194299"} 2023-02-12 00:03:14,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:14,305 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:14,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 494 msec 2023-02-12 00:03:14,313 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:14,314 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:14,314 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:14,318 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:14,325 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:14,327 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:14,335 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:14,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 00:03:14,349 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:14,363 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:14,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-12 00:03:14,373 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:14,376 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.278sec 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40739,1676160192924-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:14,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40739,1676160192924-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:14,379 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:14,397 DEBUG [Listener at localhost/42847] zookeeper.ReadOnlyZKClient(139): Connect 0x3f271f07 to 127.0.0.1:55516 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:14,405 DEBUG [Listener at localhost/42847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bcfe385, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:14,407 DEBUG [hconnection-0xada79b0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:14,409 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:14,417 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:14,417 DEBUG [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:14,420 DEBUG [Listener at localhost/42847] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:14,423 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:14,423 INFO [Listener at localhost/42847] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 00:03:14,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-12 00:03:14,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:14,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.10:38374 deadline: 1676160254424, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 00:03:14,425 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 00:03:14,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:14,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 00:03:14,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:14,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 00:03:14,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:14,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:14,445 INFO [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43357%2C1676160193060, suffix=, logDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43357,1676160193060, archiveDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs, maxLogs=32 2023-02-12 00:03:14,451 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:14,451 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056 2023-02-12 00:03:14,451 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5 2023-02-12 00:03:14,451 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056 empty. 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920 empty. 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5 empty. 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5 empty. 2023-02-12 00:03:14,452 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f empty. 2023-02-12 00:03:14,454 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4 empty. 2023-02-12 00:03:14,454 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171 empty. 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3 empty. 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:14,455 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d empty. 2023-02-12 00:03:14,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97 empty. 2023-02-12 00:03:14,456 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:14,456 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:14,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:14,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 00:03:14,466 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK] 2023-02-12 00:03:14,468 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK] 2023-02-12 00:03:14,475 INFO [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/WALs/jenkins-hbase9.apache.org,43357,1676160193060/jenkins-hbase9.apache.org%2C43357%2C1676160193060.1676160194446 2023-02-12 00:03:14,475 DEBUG [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK]] 2023-02-12 00:03:14,476 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:14,484 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 307c756c745df0facbca059cf3516056, NAME => 'testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,484 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 70540f7a4e3335b30ef110a69ea53ce5, NAME => 'testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,492 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 745573e545c8759c84e229997b4340d5, NAME => 'testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,516 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 70540f7a4e3335b30ef110a69ea53ce5, disabling compactions & flushes 2023-02-12 00:03:14,516 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:14,516 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:14,516 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. after waiting 0 ms 2023-02-12 00:03:14,516 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:14,516 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:14,516 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 70540f7a4e3335b30ef110a69ea53ce5: Waiting for close lock at 1676160194516Disabling compacts and flushes for region at 1676160194516Disabling writes for close at 1676160194516Writing region close event to WAL at 1676160194516Closed at 1676160194516 2023-02-12 00:03:14,516 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7c0c86859ac5120f0deac2333ce7920, NAME => 'testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,519 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,519 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 745573e545c8759c84e229997b4340d5, disabling compactions & flushes 2023-02-12 00:03:14,519 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:14,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:14,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. after waiting 0 ms 2023-02-12 00:03:14,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:14,520 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:14,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 745573e545c8759c84e229997b4340d5: Waiting for close lock at 1676160194519Disabling compacts and flushes for region at 1676160194519Disabling writes for close at 1676160194520 (+1 ms)Writing region close event to WAL at 1676160194520Closed at 1676160194520 2023-02-12 00:03:14,520 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e4e4e99323e1ae6220f2d9709d4a6171, NAME => 'testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e7c0c86859ac5120f0deac2333ce7920, disabling compactions & flushes 2023-02-12 00:03:14,529 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. after waiting 0 ms 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:14,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e7c0c86859ac5120f0deac2333ce7920: Waiting for close lock at 1676160194529Disabling compacts and flushes for region at 1676160194529Disabling writes for close at 1676160194530 (+1 ms)Writing region close event to WAL at 1676160194530Closed at 1676160194530 2023-02-12 00:03:14,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d557477c9f6c230e14d9cb66e67a5dc4, NAME => 'testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 307c756c745df0facbca059cf3516056, disabling compactions & flushes 2023-02-12 00:03:14,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:14,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:14,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. after waiting 0 ms 2023-02-12 00:03:14,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:14,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:14,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 307c756c745df0facbca059cf3516056: Waiting for close lock at 1676160194530Disabling compacts and flushes for region at 1676160194530Disabling writes for close at 1676160194531 (+1 ms)Writing region close event to WAL at 1676160194531Closed at 1676160194531 2023-02-12 00:03:14,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6b2bd708e1adbbd9e939e594458371f3, NAME => 'testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:14,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d557477c9f6c230e14d9cb66e67a5dc4, disabling compactions & flushes 2023-02-12 00:03:14,543 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:14,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:14,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. after waiting 0 ms 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6b2bd708e1adbbd9e939e594458371f3, disabling compactions & flushes 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:14,544 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:14,544 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. after waiting 0 ms 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d557477c9f6c230e14d9cb66e67a5dc4: Waiting for close lock at 1676160194543Disabling compacts and flushes for region at 1676160194543Disabling writes for close at 1676160194544 (+1 ms)Writing region close event to WAL at 1676160194544Closed at 1676160194544 2023-02-12 00:03:14,544 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:14,544 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6b2bd708e1adbbd9e939e594458371f3: Waiting for close lock at 1676160194544Disabling compacts and flushes for region at 1676160194544Disabling writes for close at 1676160194544Writing region close event to WAL at 1676160194544Closed at 1676160194544 2023-02-12 00:03:14,544 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f8a319fc5ab773730c7fa584f461469f, NAME => 'testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,545 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9adf18cc115e5eebdd407b3a7640ea97, NAME => 'testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9adf18cc115e5eebdd407b3a7640ea97, disabling compactions & flushes 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f8a319fc5ab773730c7fa584f461469f, disabling compactions & flushes 2023-02-12 00:03:14,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:14,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. after waiting 0 ms 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:14,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9adf18cc115e5eebdd407b3a7640ea97: Waiting for close lock at 1676160194558Disabling compacts and flushes for region at 1676160194558Disabling writes for close at 1676160194558Writing region close event to WAL at 1676160194558Closed at 1676160194558 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. after waiting 0 ms 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:14,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:14,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f8a319fc5ab773730c7fa584f461469f: Waiting for close lock at 1676160194558Disabling compacts and flushes for region at 1676160194558Disabling writes for close at 1676160194558Writing region close event to WAL at 1676160194558Closed at 1676160194558 2023-02-12 00:03:14,559 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 356540f3b3883ee20044031e07aff84d, NAME => 'testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.tmp 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 356540f3b3883ee20044031e07aff84d, disabling compactions & flushes 2023-02-12 00:03:14,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. after waiting 0 ms 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:14,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:14,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 356540f3b3883ee20044031e07aff84d: Waiting for close lock at 1676160194565Disabling compacts and flushes for region at 1676160194565Disabling writes for close at 1676160194565Writing region close event to WAL at 1676160194565Closed at 1676160194565 2023-02-12 00:03:14,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:14,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:14,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e4e4e99323e1ae6220f2d9709d4a6171, disabling compactions & flushes 2023-02-12 00:03:14,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:14,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:14,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. after waiting 0 ms 2023-02-12 00:03:14,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:14,939 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:14,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e4e4e99323e1ae6220f2d9709d4a6171: Waiting for close lock at 1676160194938Disabling compacts and flushes for region at 1676160194938Disabling writes for close at 1676160194939 (+1 ms)Writing region close event to WAL at 1676160194939Closed at 1676160194939 2023-02-12 00:03:14,941 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:14,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676160194427.745573e545c8759c84e229997b4340d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160194942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160194942"}]},"ts":"1676160194942"} 2023-02-12 00:03:14,946 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 00:03:14,947 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:14,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160194947"}]},"ts":"1676160194947"} 2023-02-12 00:03:14,949 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 00:03:14,954 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:14,961 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:14,961 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:14,961 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:14,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70540f7a4e3335b30ef110a69ea53ce5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=307c756c745df0facbca059cf3516056, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=745573e545c8759c84e229997b4340d5, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e7c0c86859ac5120f0deac2333ce7920, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e4e4e99323e1ae6220f2d9709d4a6171, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d557477c9f6c230e14d9cb66e67a5dc4, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b2bd708e1adbbd9e939e594458371f3, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a319fc5ab773730c7fa584f461469f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9adf18cc115e5eebdd407b3a7640ea97, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=356540f3b3883ee20044031e07aff84d, ASSIGN}] 2023-02-12 00:03:14,963 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=307c756c745df0facbca059cf3516056, ASSIGN 2023-02-12 00:03:14,964 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70540f7a4e3335b30ef110a69ea53ce5, ASSIGN 2023-02-12 00:03:14,964 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=745573e545c8759c84e229997b4340d5, ASSIGN 2023-02-12 00:03:14,964 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=356540f3b3883ee20044031e07aff84d, ASSIGN 2023-02-12 00:03:14,964 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=307c756c745df0facbca059cf3516056, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,965 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=70540f7a4e3335b30ef110a69ea53ce5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43357,1676160193060; forceNewPlan=false, retain=false 2023-02-12 00:03:14,965 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=745573e545c8759c84e229997b4340d5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,965 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=356540f3b3883ee20044031e07aff84d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43357,1676160193060; forceNewPlan=false, retain=false 2023-02-12 00:03:14,966 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9adf18cc115e5eebdd407b3a7640ea97, ASSIGN 2023-02-12 00:03:14,966 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8a319fc5ab773730c7fa584f461469f, ASSIGN 2023-02-12 00:03:14,966 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b2bd708e1adbbd9e939e594458371f3, ASSIGN 2023-02-12 00:03:14,966 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d557477c9f6c230e14d9cb66e67a5dc4, ASSIGN 2023-02-12 00:03:14,966 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e4e4e99323e1ae6220f2d9709d4a6171, ASSIGN 2023-02-12 00:03:14,967 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8a319fc5ab773730c7fa584f461469f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,967 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9adf18cc115e5eebdd407b3a7640ea97, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43357,1676160193060; forceNewPlan=false, retain=false 2023-02-12 00:03:14,967 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6b2bd708e1adbbd9e939e594458371f3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,968 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d557477c9f6c230e14d9cb66e67a5dc4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43357,1676160193060; forceNewPlan=false, retain=false 2023-02-12 00:03:14,968 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e4e4e99323e1ae6220f2d9709d4a6171, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43729,1676160193014; forceNewPlan=false, retain=false 2023-02-12 00:03:14,968 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e7c0c86859ac5120f0deac2333ce7920, ASSIGN 2023-02-12 00:03:14,969 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e7c0c86859ac5120f0deac2333ce7920, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43357,1676160193060; forceNewPlan=false, retain=false 2023-02-12 00:03:15,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:15,115 INFO [jenkins-hbase9:40739] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 00:03:15,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e4e4e99323e1ae6220f2d9709d4a6171, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,118 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=307c756c745df0facbca059cf3516056, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,118 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f8a319fc5ab773730c7fa584f461469f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195118"}]},"ts":"1676160195118"} 2023-02-12 00:03:15,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195118"}]},"ts":"1676160195118"} 2023-02-12 00:03:15,118 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=745573e545c8759c84e229997b4340d5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,118 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6b2bd708e1adbbd9e939e594458371f3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676160194427.745573e545c8759c84e229997b4340d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195118"}]},"ts":"1676160195118"} 2023-02-12 00:03:15,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195118"}]},"ts":"1676160195118"} 2023-02-12 00:03:15,119 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195118"}]},"ts":"1676160195118"} 2023-02-12 00:03:15,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure e4e4e99323e1ae6220f2d9709d4a6171, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:15,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 307c756c745df0facbca059cf3516056, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:15,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 745573e545c8759c84e229997b4340d5, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:15,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure f8a319fc5ab773730c7fa584f461469f, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:15,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 6b2bd708e1adbbd9e939e594458371f3, server=jenkins-hbase9.apache.org,43729,1676160193014}] 2023-02-12 00:03:15,127 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9adf18cc115e5eebdd407b3a7640ea97, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,128 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195127"}]},"ts":"1676160195127"} 2023-02-12 00:03:15,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=70540f7a4e3335b30ef110a69ea53ce5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160195129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195129"}]},"ts":"1676160195129"} 2023-02-12 00:03:15,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d557477c9f6c230e14d9cb66e67a5dc4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,131 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195130"}]},"ts":"1676160195130"} 2023-02-12 00:03:15,131 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e7c0c86859ac5120f0deac2333ce7920, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,131 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195131"}]},"ts":"1676160195131"} 2023-02-12 00:03:15,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=356540f3b3883ee20044031e07aff84d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160195131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160195131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160195131"}]},"ts":"1676160195131"} 2023-02-12 00:03:15,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 9adf18cc115e5eebdd407b3a7640ea97, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:15,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 70540f7a4e3335b30ef110a69ea53ce5, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:15,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure d557477c9f6c230e14d9cb66e67a5dc4, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:15,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure e7c0c86859ac5120f0deac2333ce7920, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:15,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 356540f3b3883ee20044031e07aff84d, server=jenkins-hbase9.apache.org,43357,1676160193060}] 2023-02-12 00:03:15,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:15,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4e4e99323e1ae6220f2d9709d4a6171, NAME => 'testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 00:03:15,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,280 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,282 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1 2023-02-12 00:03:15,282 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1 2023-02-12 00:03:15,282 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e4e99323e1ae6220f2d9709d4a6171 columnFamilyName f1 2023-02-12 00:03:15,282 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(310): Store=e4e4e99323e1ae6220f2d9709d4a6171/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,283 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,284 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2 2023-02-12 00:03:15,284 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2 2023-02-12 00:03:15,284 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e4e99323e1ae6220f2d9709d4a6171 columnFamilyName f2 2023-02-12 00:03:15,285 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(310): Store=e4e4e99323e1ae6220f2d9709d4a6171/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e7c0c86859ac5120f0deac2333ce7920, NAME => 'testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:15,290 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,292 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1 2023-02-12 00:03:15,292 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1 2023-02-12 00:03:15,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e4e4e99323e1ae6220f2d9709d4a6171; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68783335, jitterRate=0.02495156228542328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e4e4e99323e1ae6220f2d9709d4a6171: Running coprocessor pre-open hook at 1676160195279Writing region info on filesystem at 1676160195279Initializing all the Stores at 1676160195280 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195280Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195280Cleaning up temporary data from old regions at 1676160195286 (+6 ms)Cleaning up detritus from prior splits at 1676160195287 (+1 ms)Running coprocessor post-open hooks at 1676160195292 (+5 ms)Region opened successfully at 1676160195292 2023-02-12 00:03:15,292 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7c0c86859ac5120f0deac2333ce7920 columnFamilyName f1 2023-02-12 00:03:15,293 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(310): Store=e7c0c86859ac5120f0deac2333ce7920/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171., pid=21, masterSystemTime=1676160195275 2023-02-12 00:03:15,293 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,294 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2 2023-02-12 00:03:15,294 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2 2023-02-12 00:03:15,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:15,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:15,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:15,295 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7c0c86859ac5120f0deac2333ce7920 columnFamilyName f2 2023-02-12 00:03:15,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8a319fc5ab773730c7fa584f461469f, NAME => 'testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 00:03:15,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e4e4e99323e1ae6220f2d9709d4a6171, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195295"}]},"ts":"1676160195295"} 2023-02-12 00:03:15,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,296 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(310): Store=e7c0c86859ac5120f0deac2333ce7920/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,297 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,299 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1 2023-02-12 00:03:15,299 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1 2023-02-12 00:03:15,299 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a319fc5ab773730c7fa584f461469f columnFamilyName f1 2023-02-12 00:03:15,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-12 00:03:15,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure e4e4e99323e1ae6220f2d9709d4a6171, server=jenkins-hbase9.apache.org,43729,1676160193014 in 176 msec 2023-02-12 00:03:15,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,300 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(310): Store=f8a319fc5ab773730c7fa584f461469f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,300 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:15,301 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2 2023-02-12 00:03:15,301 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2 2023-02-12 00:03:15,302 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a319fc5ab773730c7fa584f461469f columnFamilyName f2 2023-02-12 00:03:15,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e4e4e99323e1ae6220f2d9709d4a6171, ASSIGN in 339 msec 2023-02-12 00:03:15,302 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(310): Store=f8a319fc5ab773730c7fa584f461469f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e7c0c86859ac5120f0deac2333ce7920; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75459070, jitterRate=0.12442776560783386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e7c0c86859ac5120f0deac2333ce7920: Running coprocessor pre-open hook at 1676160195289Writing region info on filesystem at 1676160195289Initializing all the Stores at 1676160195290 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195290Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195290Cleaning up temporary data from old regions at 1676160195298 (+8 ms)Cleaning up detritus from prior splits at 1676160195299 (+1 ms)Running coprocessor post-open hooks at 1676160195304 (+5 ms)Region opened successfully at 1676160195304 2023-02-12 00:03:15,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920., pid=29, masterSystemTime=1676160195286 2023-02-12 00:03:15,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:15,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:15,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9adf18cc115e5eebdd407b3a7640ea97, NAME => 'testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,307 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e7c0c86859ac5120f0deac2333ce7920, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,307 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195307"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195307"}]},"ts":"1676160195307"} 2023-02-12 00:03:15,309 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,310 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1 2023-02-12 00:03:15,310 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1 2023-02-12 00:03:15,311 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9adf18cc115e5eebdd407b3a7640ea97 columnFamilyName f1 2023-02-12 00:03:15,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f8a319fc5ab773730c7fa584f461469f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73914988, jitterRate=0.10141915082931519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,311 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(310): Store=9adf18cc115e5eebdd407b3a7640ea97/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f8a319fc5ab773730c7fa584f461469f: Running coprocessor pre-open hook at 1676160195296Writing region info on filesystem at 1676160195296Initializing all the Stores at 1676160195296Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195297 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195297Cleaning up temporary data from old regions at 1676160195305 (+8 ms)Cleaning up detritus from prior splits at 1676160195305Running coprocessor post-open hooks at 1676160195311 (+6 ms)Region opened successfully at 1676160195311 2023-02-12 00:03:15,312 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f., pid=24, masterSystemTime=1676160195275 2023-02-12 00:03:15,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-12 00:03:15,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure e7c0c86859ac5120f0deac2333ce7920, server=jenkins-hbase9.apache.org,43357,1676160193060 in 174 msec 2023-02-12 00:03:15,313 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2 2023-02-12 00:03:15,313 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2 2023-02-12 00:03:15,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e7c0c86859ac5120f0deac2333ce7920, ASSIGN in 351 msec 2023-02-12 00:03:15,314 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9adf18cc115e5eebdd407b3a7640ea97 columnFamilyName f2 2023-02-12 00:03:15,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:15,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:15,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:15,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b2bd708e1adbbd9e939e594458371f3, NAME => 'testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 00:03:15,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f8a319fc5ab773730c7fa584f461469f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,314 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(310): Store=9adf18cc115e5eebdd407b3a7640ea97/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,314 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195314"}]},"ts":"1676160195314"} 2023-02-12 00:03:15,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,316 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,317 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1 2023-02-12 00:03:15,317 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1 2023-02-12 00:03:15,317 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b2bd708e1adbbd9e939e594458371f3 columnFamilyName f1 2023-02-12 00:03:15,318 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(310): Store=6b2bd708e1adbbd9e939e594458371f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,318 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,319 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2 2023-02-12 00:03:15,319 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2 2023-02-12 00:03:15,319 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b2bd708e1adbbd9e939e594458371f3 columnFamilyName f2 2023-02-12 00:03:15,320 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(310): Store=6b2bd708e1adbbd9e939e594458371f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:15,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-12 00:03:15,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure f8a319fc5ab773730c7fa584f461469f, server=jenkins-hbase9.apache.org,43729,1676160193014 in 199 msec 2023-02-12 00:03:15,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8a319fc5ab773730c7fa584f461469f, ASSIGN in 364 msec 2023-02-12 00:03:15,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:15,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 6b2bd708e1adbbd9e939e594458371f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64282812, jitterRate=-0.04211145639419556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 6b2bd708e1adbbd9e939e594458371f3: Running coprocessor pre-open hook at 1676160195315Writing region info on filesystem at 1676160195315Initializing all the Stores at 1676160195316 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195316Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195316Cleaning up temporary data from old regions at 1676160195321 (+5 ms)Cleaning up detritus from prior splits at 1676160195321Running coprocessor post-open hooks at 1676160195326 (+5 ms)Region opened successfully at 1676160195326 2023-02-12 00:03:15,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3., pid=25, masterSystemTime=1676160195275 2023-02-12 00:03:15,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:15,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 9adf18cc115e5eebdd407b3a7640ea97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67817054, jitterRate=0.010552853345870972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6b2bd708e1adbbd9e939e594458371f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 9adf18cc115e5eebdd407b3a7640ea97: Running coprocessor pre-open hook at 1676160195308Writing region info on filesystem at 1676160195308Initializing all the Stores at 1676160195308Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195308Cleaning up temporary data from old regions at 1676160195323 (+15 ms)Cleaning up detritus from prior splits at 1676160195324 (+1 ms)Running coprocessor post-open hooks at 1676160195329 (+5 ms)Region opened successfully at 1676160195329 2023-02-12 00:03:15,329 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195329"}]},"ts":"1676160195329"} 2023-02-12 00:03:15,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:15,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:15,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 307c756c745df0facbca059cf3516056, NAME => 'testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 00:03:15,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97., pid=26, masterSystemTime=1676160195286 2023-02-12 00:03:15,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,331 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:15,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:15,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:15,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d557477c9f6c230e14d9cb66e67a5dc4, NAME => 'testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 00:03:15,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9adf18cc115e5eebdd407b3a7640ea97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195332"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195332"}]},"ts":"1676160195332"} 2023-02-12 00:03:15,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,334 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-12 00:03:15,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 6b2bd708e1adbbd9e939e594458371f3, server=jenkins-hbase9.apache.org,43729,1676160193014 in 206 msec 2023-02-12 00:03:15,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6b2bd708e1adbbd9e939e594458371f3, ASSIGN in 373 msec 2023-02-12 00:03:15,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-12 00:03:15,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 9adf18cc115e5eebdd407b3a7640ea97, server=jenkins-hbase9.apache.org,43357,1676160193060 in 202 msec 2023-02-12 00:03:15,337 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1 2023-02-12 00:03:15,337 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1 2023-02-12 00:03:15,337 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d557477c9f6c230e14d9cb66e67a5dc4 columnFamilyName f1 2023-02-12 00:03:15,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9adf18cc115e5eebdd407b3a7640ea97, ASSIGN in 375 msec 2023-02-12 00:03:15,343 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1 2023-02-12 00:03:15,343 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1 2023-02-12 00:03:15,343 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(310): Store=d557477c9f6c230e14d9cb66e67a5dc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,343 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,343 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307c756c745df0facbca059cf3516056 columnFamilyName f1 2023-02-12 00:03:15,344 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(310): Store=307c756c745df0facbca059cf3516056/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,344 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,345 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2 2023-02-12 00:03:15,345 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2 2023-02-12 00:03:15,345 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d557477c9f6c230e14d9cb66e67a5dc4 columnFamilyName f2 2023-02-12 00:03:15,345 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(310): Store=d557477c9f6c230e14d9cb66e67a5dc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,346 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2 2023-02-12 00:03:15,346 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2 2023-02-12 00:03:15,346 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307c756c745df0facbca059cf3516056 columnFamilyName f2 2023-02-12 00:03:15,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,347 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(310): Store=307c756c745df0facbca059cf3516056/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 307c756c745df0facbca059cf3516056 2023-02-12 00:03:15,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d557477c9f6c230e14d9cb66e67a5dc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69077590, jitterRate=0.02933630347251892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d557477c9f6c230e14d9cb66e67a5dc4: Running coprocessor pre-open hook at 1676160195333Writing region info on filesystem at 1676160195333Initializing all the Stores at 1676160195334 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195334Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195334Cleaning up temporary data from old regions at 1676160195348 (+14 ms)Cleaning up detritus from prior splits at 1676160195348Running coprocessor post-open hooks at 1676160195355 (+7 ms)Region opened successfully at 1676160195355 2023-02-12 00:03:15,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 307c756c745df0facbca059cf3516056; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71653519, jitterRate=0.06772063672542572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 307c756c745df0facbca059cf3516056: Running coprocessor pre-open hook at 1676160195330Writing region info on filesystem at 1676160195330Initializing all the Stores at 1676160195331 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195331Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195331Cleaning up temporary data from old regions at 1676160195349 (+18 ms)Cleaning up detritus from prior splits at 1676160195349Running coprocessor post-open hooks at 1676160195355 (+6 ms)Region opened successfully at 1676160195355 2023-02-12 00:03:15,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4., pid=28, masterSystemTime=1676160195286 2023-02-12 00:03:15,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056., pid=22, masterSystemTime=1676160195275 2023-02-12 00:03:15,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:15,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:15,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70540f7a4e3335b30ef110a69ea53ce5, NAME => 'testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 00:03:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d557477c9f6c230e14d9cb66e67a5dc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,359 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195358"}]},"ts":"1676160195358"} 2023-02-12 00:03:15,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:15,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:15,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:15,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 745573e545c8759c84e229997b4340d5, NAME => 'testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 00:03:15,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=307c756c745df0facbca059cf3516056, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195360"}]},"ts":"1676160195360"} 2023-02-12 00:03:15,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-12 00:03:15,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure d557477c9f6c230e14d9cb66e67a5dc4, server=jenkins-hbase9.apache.org,43357,1676160193060 in 227 msec 2023-02-12 00:03:15,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-12 00:03:15,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 307c756c745df0facbca059cf3516056, server=jenkins-hbase9.apache.org,43729,1676160193014 in 240 msec 2023-02-12 00:03:15,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d557477c9f6c230e14d9cb66e67a5dc4, ASSIGN in 402 msec 2023-02-12 00:03:15,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=307c756c745df0facbca059cf3516056, ASSIGN in 403 msec 2023-02-12 00:03:15,370 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,370 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,372 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1 2023-02-12 00:03:15,372 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1 2023-02-12 00:03:15,372 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f1 2023-02-12 00:03:15,372 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f1 2023-02-12 00:03:15,372 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 745573e545c8759c84e229997b4340d5 columnFamilyName f1 2023-02-12 00:03:15,372 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70540f7a4e3335b30ef110a69ea53ce5 columnFamilyName f1 2023-02-12 00:03:15,373 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(310): Store=745573e545c8759c84e229997b4340d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,373 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(310): Store=70540f7a4e3335b30ef110a69ea53ce5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,373 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,373 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,374 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2 2023-02-12 00:03:15,374 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2 2023-02-12 00:03:15,374 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f2 2023-02-12 00:03:15,374 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f2 2023-02-12 00:03:15,375 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 745573e545c8759c84e229997b4340d5 columnFamilyName f2 2023-02-12 00:03:15,375 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70540f7a4e3335b30ef110a69ea53ce5 columnFamilyName f2 2023-02-12 00:03:15,375 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(310): Store=745573e545c8759c84e229997b4340d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,375 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(310): Store=70540f7a4e3335b30ef110a69ea53ce5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:15,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 745573e545c8759c84e229997b4340d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70180181, jitterRate=0.0457661896944046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 745573e545c8759c84e229997b4340d5: Running coprocessor pre-open hook at 1676160195361Writing region info on filesystem at 1676160195361Initializing all the Stores at 1676160195362 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195362Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195370 (+8 ms)Cleaning up temporary data from old regions at 1676160195377 (+7 ms)Cleaning up detritus from prior splits at 1676160195378 (+1 ms)Running coprocessor post-open hooks at 1676160195382 (+4 ms)Region opened successfully at 1676160195382 2023-02-12 00:03:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5., pid=23, masterSystemTime=1676160195275 2023-02-12 00:03:15,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 70540f7a4e3335b30ef110a69ea53ce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59937181, jitterRate=-0.10686640441417694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 70540f7a4e3335b30ef110a69ea53ce5: Running coprocessor pre-open hook at 1676160195358Writing region info on filesystem at 1676160195358Initializing all the Stores at 1676160195359 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195359Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195370 (+11 ms)Cleaning up temporary data from old regions at 1676160195377 (+7 ms)Cleaning up detritus from prior splits at 1676160195378 (+1 ms)Running coprocessor post-open hooks at 1676160195383 (+5 ms)Region opened successfully at 1676160195383 2023-02-12 00:03:15,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5., pid=27, masterSystemTime=1676160195286 2023-02-12 00:03:15,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:15,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:15,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=745573e545c8759c84e229997b4340d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676160194427.745573e545c8759c84e229997b4340d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676160195385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195385"}]},"ts":"1676160195385"} 2023-02-12 00:03:15,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:15,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=70540f7a4e3335b30ef110a69ea53ce5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160195387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195387"}]},"ts":"1676160195387"} 2023-02-12 00:03:15,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:15,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:15,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-12 00:03:15,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 745573e545c8759c84e229997b4340d5, server=jenkins-hbase9.apache.org,43729,1676160193014 in 265 msec 2023-02-12 00:03:15,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-12 00:03:15,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 70540f7a4e3335b30ef110a69ea53ce5, server=jenkins-hbase9.apache.org,43357,1676160193060 in 256 msec 2023-02-12 00:03:15,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=745573e545c8759c84e229997b4340d5, ASSIGN in 430 msec 2023-02-12 00:03:15,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70540f7a4e3335b30ef110a69ea53ce5, ASSIGN in 430 msec 2023-02-12 00:03:15,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 356540f3b3883ee20044031e07aff84d, NAME => 'testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 00:03:15,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:15,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,397 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,398 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f1 2023-02-12 00:03:15,398 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f1 2023-02-12 00:03:15,399 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 356540f3b3883ee20044031e07aff84d columnFamilyName f1 2023-02-12 00:03:15,400 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(310): Store=356540f3b3883ee20044031e07aff84d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,400 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,401 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f2 2023-02-12 00:03:15,401 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f2 2023-02-12 00:03:15,402 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 356540f3b3883ee20044031e07aff84d columnFamilyName f2 2023-02-12 00:03:15,402 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(310): Store=356540f3b3883ee20044031e07aff84d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:15,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:15,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:15,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:15,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 356540f3b3883ee20044031e07aff84d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73420854, jitterRate=0.09405598044395447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:15,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 356540f3b3883ee20044031e07aff84d: Running coprocessor pre-open hook at 1676160195395Writing region info on filesystem at 1676160195395Initializing all the Stores at 1676160195396 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195396Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160195397 (+1 ms)Cleaning up temporary data from old regions at 1676160195405 (+8 ms)Cleaning up detritus from prior splits at 1676160195405Running coprocessor post-open hooks at 1676160195410 (+5 ms)Region opened successfully at 1676160195410 2023-02-12 00:03:15,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d., pid=30, masterSystemTime=1676160195286 2023-02-12 00:03:15,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:15,415 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=356540f3b3883ee20044031e07aff84d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:15,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676160195415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160195415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160195415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160195415"}]},"ts":"1676160195415"} 2023-02-12 00:03:15,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-12 00:03:15,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 356540f3b3883ee20044031e07aff84d, server=jenkins-hbase9.apache.org,43357,1676160193060 in 280 msec 2023-02-12 00:03:15,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-12 00:03:15,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=356540f3b3883ee20044031e07aff84d, ASSIGN in 458 msec 2023-02-12 00:03:15,422 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:15,422 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160195422"}]},"ts":"1676160195422"} 2023-02-12 00:03:15,424 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 00:03:15,431 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:15,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0030 sec 2023-02-12 00:03:15,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:15,549 INFO [Listener at localhost/42847] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 00:03:15,549 DEBUG [Listener at localhost/42847] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 00:03:15,549 INFO [Listener at localhost/42847] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:15,553 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 00:03:15,553 INFO [Listener at localhost/42847] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:15,553 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 00:03:15,553 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:15,608 DEBUG [hconnection-0xada79b0-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:15,625 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43357] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:15,628 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:15,638 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43729] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:15,717 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:15,717 INFO [Listener at localhost/42847] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:15,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:15,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160195719 (current time:1676160195719). 2023-02-12 00:03:15,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:15,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] zookeeper.ReadOnlyZKClient(139): Connect 0x233a923c to 127.0.0.1:55516 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:15,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17079b61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:15,727 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:15,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x233a923c to 127.0.0.1:55516 2023-02-12 00:03:15,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:15,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:15,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:15,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:15,731 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:15,732 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676160795732 2023-02-12 00:03:15,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:15,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 00:03:15,733 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:15,733 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:15,734 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:15,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:15,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-12 00:03:15,735 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:15,736 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676160795736 2023-02-12 00:03:15,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,748 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-12 00:03:15,748 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:15,749 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-12 00:03:15,749 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-12 00:03:15,749 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,750 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,752 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:15,752 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:15,752 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:15,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:15,753 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,753 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,753 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,753 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,754 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 00:03:15,754 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 00:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 00:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43357,1676160193060' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 00:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 00:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:15,756 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 00:03:15,756 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 00:03:15,756 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43729,1676160193014' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 00:03:15,757 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,757 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:15,758 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,758 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:15,758 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,758 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:15,759 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,759 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43357,1676160193060' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a27e464[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:15,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43729,1676160193014' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 00:03:15,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a27e464[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:15,763 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-12 00:03:15,763 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,765 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,765 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,766 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:15,766 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:15,766 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. started... 2023-02-12 00:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:15,766 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:15,766 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. started... 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 70540f7a4e3335b30ef110a69ea53ce5: 2023-02-12 00:03:15,767 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9adf18cc115e5eebdd407b3a7640ea97 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. started... 2023-02-12 00:03:15,767 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:15,768 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:15,771 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:15,771 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 356540f3b3883ee20044031e07aff84d: 2023-02-12 00:03:15,771 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,771 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:15,772 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:15,772 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:15,771 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. started... 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. started... 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. started... 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:15,775 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:15,779 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f8a319fc5ab773730c7fa584f461469f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:15,779 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 307c756c745df0facbca059cf3516056 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:15,779 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e4e4e99323e1ae6220f2d9709d4a6171 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:15,815 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. completed. 2023-02-12 00:03:15,815 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:15,815 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:15,815 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:15,815 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. started... 2023-02-12 00:03:15,818 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d557477c9f6c230e14d9cb66e67a5dc4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:15,827 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f1/de540c4286054a978de31cfae9a85563 2023-02-12 00:03:15,834 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:15,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:15,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:15,836 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:15,855 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f1/9cc5a364172648888ce14d76865098af 2023-02-12 00:03:15,863 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. completed. 2023-02-12 00:03:15,863 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:15,863 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:15,863 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:15,863 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. started... 2023-02-12 00:03:15,863 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e7c0c86859ac5120f0deac2333ce7920 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:15,888 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f1/567d70e66f4742b89a982822f55c7ec3 2023-02-12 00:03:15,888 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f1/60e410481936404f954085e8e20f8a2b 2023-02-12 00:03:15,911 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f1/fbc53c06dbd943419f728a7181162a20 2023-02-12 00:03:15,916 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f2/6385afa95246453eb5fabfa0a9a18033 2023-02-12 00:03:15,921 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f2/66b30810d838430490896678377a03f1 2023-02-12 00:03:15,931 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f1/de540c4286054a978de31cfae9a85563 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/de540c4286054a978de31cfae9a85563 2023-02-12 00:03:15,933 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:15,949 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f1/9cc5a364172648888ce14d76865098af as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/9cc5a364172648888ce14d76865098af 2023-02-12 00:03:15,950 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/de540c4286054a978de31cfae9a85563, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:15,951 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f2/66b30810d838430490896678377a03f1 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/66b30810d838430490896678377a03f1 2023-02-12 00:03:15,961 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/9cc5a364172648888ce14d76865098af, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:15,965 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f2/6385afa95246453eb5fabfa0a9a18033 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/6385afa95246453eb5fabfa0a9a18033 2023-02-12 00:03:15,967 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f2/3068f60904cb46d0a4c57e0b051fc923 2023-02-12 00:03:15,970 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f2/d33454dff3b74a2d80d63f964af25d3b 2023-02-12 00:03:15,979 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/66b30810d838430490896678377a03f1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:15,981 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 9adf18cc115e5eebdd407b3a7640ea97 in 214ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:15,981 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 00:03:15,981 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9adf18cc115e5eebdd407b3a7640ea97: 2023-02-12 00:03:15,982 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,982 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:15,983 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/de540c4286054a978de31cfae9a85563] hfiles 2023-02-12 00:03:15,983 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/de540c4286054a978de31cfae9a85563 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,983 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/66b30810d838430490896678377a03f1] hfiles 2023-02-12 00:03:15,983 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/66b30810d838430490896678377a03f1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:15,992 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f2/d9a3ba65ca624e31962571116688436d 2023-02-12 00:03:16,001 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f1/fbc53c06dbd943419f728a7181162a20 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/fbc53c06dbd943419f728a7181162a20 2023-02-12 00:03:16,006 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/fbc53c06dbd943419f728a7181162a20, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,007 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/6385afa95246453eb5fabfa0a9a18033, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,008 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f2/d33454dff3b74a2d80d63f964af25d3b as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/d33454dff3b74a2d80d63f964af25d3b 2023-02-12 00:03:16,008 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8a319fc5ab773730c7fa584f461469f in 229ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,013 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f1/567d70e66f4742b89a982822f55c7ec3 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/567d70e66f4742b89a982822f55c7ec3 2023-02-12 00:03:16,014 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/d33454dff3b74a2d80d63f964af25d3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f8a319fc5ab773730c7fa584f461469f: 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/9cc5a364172648888ce14d76865098af] hfiles 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/9cc5a364172648888ce14d76865098af for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/6385afa95246453eb5fabfa0a9a18033] hfiles 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/6385afa95246453eb5fabfa0a9a18033 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,016 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d557477c9f6c230e14d9cb66e67a5dc4 in 198ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d557477c9f6c230e14d9cb66e67a5dc4: 2023-02-12 00:03:16,016 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,017 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,017 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/fbc53c06dbd943419f728a7181162a20] hfiles 2023-02-12 00:03:16,017 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/fbc53c06dbd943419f728a7181162a20 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,017 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/d33454dff3b74a2d80d63f964af25d3b] hfiles 2023-02-12 00:03:16,017 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/d33454dff3b74a2d80d63f964af25d3b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,021 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f1/60e410481936404f954085e8e20f8a2b as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/60e410481936404f954085e8e20f8a2b 2023-02-12 00:03:16,023 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/567d70e66f4742b89a982822f55c7ec3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:16,024 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f2/3068f60904cb46d0a4c57e0b051fc923 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/3068f60904cb46d0a4c57e0b051fc923 2023-02-12 00:03:16,028 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/60e410481936404f954085e8e20f8a2b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,028 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f2/d9a3ba65ca624e31962571116688436d as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/d9a3ba65ca624e31962571116688436d 2023-02-12 00:03:16,037 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:16,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:16,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:16,039 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 00:03:16,041 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/3068f60904cb46d0a4c57e0b051fc923, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:16,042 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 307c756c745df0facbca059cf3516056 in 263ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,042 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 307c756c745df0facbca059cf3516056: 2023-02-12 00:03:16,042 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,043 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,043 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/567d70e66f4742b89a982822f55c7ec3] hfiles 2023-02-12 00:03:16,043 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/567d70e66f4742b89a982822f55c7ec3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,043 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/3068f60904cb46d0a4c57e0b051fc923] hfiles 2023-02-12 00:03:16,043 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/3068f60904cb46d0a4c57e0b051fc923 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,046 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/d9a3ba65ca624e31962571116688436d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,048 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e4e4e99323e1ae6220f2d9709d4a6171 in 269ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e4e4e99323e1ae6220f2d9709d4a6171: 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/60e410481936404f954085e8e20f8a2b] hfiles 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/60e410481936404f954085e8e20f8a2b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/d9a3ba65ca624e31962571116688436d] hfiles 2023-02-12 00:03:16,048 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/d9a3ba65ca624e31962571116688436d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,058 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. completed. 2023-02-12 00:03:16,059 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:16,059 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:16,060 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. completed. 2023-02-12 00:03:16,060 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:16,060 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:16,064 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. completed. 2023-02-12 00:03:16,064 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:16,064 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:16,064 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:16,064 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. started... 2023-02-12 00:03:16,064 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6b2bd708e1adbbd9e939e594458371f3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:16,079 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. completed. 2023-02-12 00:03:16,079 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:16,079 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:16,079 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:16,079 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. started... 2023-02-12 00:03:16,079 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 745573e545c8759c84e229997b4340d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:16,098 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. completed. 2023-02-12 00:03:16,098 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:16,098 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:16,111 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f1/f0def055afc346c599d8c0fa5de4e233 2023-02-12 00:03:16,115 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f1/ffd531d314b9432483961db69dbf9232 2023-02-12 00:03:16,139 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f2/68147d3c69094e35a2d7e5794b5e3895 2023-02-12 00:03:16,142 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f2/3206f91f973d4fbb969f927896629256 2023-02-12 00:03:16,147 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f1/ffd531d314b9432483961db69dbf9232 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/ffd531d314b9432483961db69dbf9232 2023-02-12 00:03:16,150 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f1/f0def055afc346c599d8c0fa5de4e233 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/f0def055afc346c599d8c0fa5de4e233 2023-02-12 00:03:16,154 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/ffd531d314b9432483961db69dbf9232, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,155 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f2/68147d3c69094e35a2d7e5794b5e3895 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/68147d3c69094e35a2d7e5794b5e3895 2023-02-12 00:03:16,157 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/f0def055afc346c599d8c0fa5de4e233, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,158 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f2/3206f91f973d4fbb969f927896629256 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/3206f91f973d4fbb969f927896629256 2023-02-12 00:03:16,162 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/68147d3c69094e35a2d7e5794b5e3895, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,163 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 745573e545c8759c84e229997b4340d5 in 84ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 745573e545c8759c84e229997b4340d5: 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/ffd531d314b9432483961db69dbf9232] hfiles 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/ffd531d314b9432483961db69dbf9232 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/68147d3c69094e35a2d7e5794b5e3895] hfiles 2023-02-12 00:03:16,163 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/68147d3c69094e35a2d7e5794b5e3895 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,164 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/3206f91f973d4fbb969f927896629256, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,165 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6b2bd708e1adbbd9e939e594458371f3 in 101ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,165 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6b2bd708e1adbbd9e939e594458371f3: 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/f0def055afc346c599d8c0fa5de4e233] hfiles 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/f0def055afc346c599d8c0fa5de4e233 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/3206f91f973d4fbb969f927896629256] hfiles 2023-02-12 00:03:16,166 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/3206f91f973d4fbb969f927896629256 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,183 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. completed. 2023-02-12 00:03:16,183 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:16,183 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:16,186 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. completed. 2023-02-12 00:03:16,186 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:16,186 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:16,186 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:16,186 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,186 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 00:03:16,186 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,43729,1676160193014' in zk 2023-02-12 00:03:16,188 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,188 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 00:03:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:16,188 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:16,188 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 00:03:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:16,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,43729,1676160193014': 2023-02-12 00:03:16,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43729,1676160193014' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 00:03:16,339 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:16,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:16,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:16,341 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 00:03:16,343 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f1/70e4062d440e4ff8908ea3b83ff8c1e1 2023-02-12 00:03:16,363 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f2/94bdbea852d0454e8802a1bc2022ed19 2023-02-12 00:03:16,368 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f1/70e4062d440e4ff8908ea3b83ff8c1e1 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/70e4062d440e4ff8908ea3b83ff8c1e1 2023-02-12 00:03:16,373 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/70e4062d440e4ff8908ea3b83ff8c1e1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,374 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f2/94bdbea852d0454e8802a1bc2022ed19 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/94bdbea852d0454e8802a1bc2022ed19 2023-02-12 00:03:16,379 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/94bdbea852d0454e8802a1bc2022ed19, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:16,380 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e7c0c86859ac5120f0deac2333ce7920 in 517ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e7c0c86859ac5120f0deac2333ce7920: 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/70e4062d440e4ff8908ea3b83ff8c1e1] hfiles 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/70e4062d440e4ff8908ea3b83ff8c1e1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/94bdbea852d0454e8802a1bc2022ed19] hfiles 2023-02-12 00:03:16,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/94bdbea852d0454e8802a1bc2022ed19 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,389 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. completed. 2023-02-12 00:03:16,389 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:16,389 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:16,389 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:16,389 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,389 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 00:03:16,389 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,43357,1676160193060' in zk 2023-02-12 00:03:16,391 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 00:03:16,391 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,391 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:16,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:16,391 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 00:03:16,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,43357,1676160193060': 2023-02-12 00:03:16,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43357,1676160193060' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:16,395 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-12 00:03:16,395 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:16,395 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:16,395 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,396 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:16,397 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:16,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,398 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:16,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,398 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:16,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,400 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,401 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:16,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:16,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,407 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:16,408 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:16,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-12 00:03:16,407 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,408 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,409 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:16,409 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:16,409 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:16,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:16,409 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:16,409 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:16,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:16,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-12 00:03:16,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,466 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:16,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676160195732Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676160196408 (+676 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676160196408Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676160196423 (+15 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676160196439 (+16 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676160196466 (+27 ms) 2023-02-12 00:03:16,468 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:16,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 735 msec 2023-02-12 00:03:16,841 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:16,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:16,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:16,843 INFO [Listener at localhost/42847] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:16,848 INFO [Listener at localhost/42847] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:16,855 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:16,887 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43357] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:16,898 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43729] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:17,287 WARN [DataXceiver for client DFSClient_NONMAPREDUCE_1543022888_13 at /127.0.0.1:36588 [Receiving block BP-1792578548-172.31.2.10-1676160192107:blk_1073741835_1011]] datanode.BlockReceiver(732): Slow BlockReceiver write data to disk cost:373ms (threshold=300ms), volume=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/dfs/data/data1 2023-02-12 00:03:17,289 INFO [AsyncFSWAL-0-hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d-prefix:jenkins-hbase9.apache.org,43729,1676160193014] wal.AbstractFSWAL(1045): Slow sync cost: 377 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-a86afc62-b32a-4d14-aea0-9127a2aa858e,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-4d89405e-6016-419e-a75c-8524ca8bd0f7,DISK]] 2023-02-12 00:03:17,353 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:17,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:17,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 00:03:17,364 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 00:03:17,364 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:17,365 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 00:03:17,365 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 00:03:17,365 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,365 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,367 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:17,367 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:17,367 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:17,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:17,367 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,368 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,368 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,368 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:17,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:17,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:17,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:17,371 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:17,371 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:17,372 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:17,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:17,372 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:17,372 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. started... 2023-02-12 00:03:17,372 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:17,372 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:17,372 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f8a319fc5ab773730c7fa584f461469f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,375 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:17,375 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:17,375 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:17,376 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:17,375 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. started... 2023-02-12 00:03:17,376 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. started... 2023-02-12 00:03:17,376 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:17,376 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 307c756c745df0facbca059cf3516056 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:17,376 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e4e4e99323e1ae6220f2d9709d4a6171 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,376 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:17,376 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. started... 2023-02-12 00:03:17,376 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9adf18cc115e5eebdd407b3a7640ea97 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:17,377 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:17,377 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:17,377 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:17,377 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. started... 2023-02-12 00:03:17,377 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 70540f7a4e3335b30ef110a69ea53ce5: 2023-02-12 00:03:17,378 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:17,378 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:17,378 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:17,378 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. started... 2023-02-12 00:03:17,378 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d557477c9f6c230e14d9cb66e67a5dc4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,379 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:17,379 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. started... 2023-02-12 00:03:17,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 356540f3b3883ee20044031e07aff84d: 2023-02-12 00:03:17,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:17,380 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:17,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:17,380 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. started... 2023-02-12 00:03:17,380 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e7c0c86859ac5120f0deac2333ce7920 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,428 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f1/883713553ed14631818432d4d6d89118 2023-02-12 00:03:17,429 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f1/e4d3aa1eba5348b6aa4ff837a8e60b9e 2023-02-12 00:03:17,430 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f1/f5f9340e61d143dfb5abe5626d194d4a 2023-02-12 00:03:17,433 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f1/7528ba75255043869abce4d3cb5165d1 2023-02-12 00:03:17,435 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f1/1aad057ea2d444e28bfc3fca779907be 2023-02-12 00:03:17,479 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f2/4773e68665e44c4d909ae8142e605d81 2023-02-12 00:03:17,479 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f2/2e73d7801cbb42a788b0fa86b67f52d5 2023-02-12 00:03:17,486 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f1/f5f9340e61d143dfb5abe5626d194d4a as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/f5f9340e61d143dfb5abe5626d194d4a 2023-02-12 00:03:17,491 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/f5f9340e61d143dfb5abe5626d194d4a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,492 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f1/883713553ed14631818432d4d6d89118 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/883713553ed14631818432d4d6d89118 2023-02-12 00:03:17,492 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f2/1a0ea6dbb2024891a491c1eb3bd01aaa 2023-02-12 00:03:17,493 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/.tmp/f2/4773e68665e44c4d909ae8142e605d81 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/4773e68665e44c4d909ae8142e605d81 2023-02-12 00:03:17,499 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f1/1aad057ea2d444e28bfc3fca779907be as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/1aad057ea2d444e28bfc3fca779907be 2023-02-12 00:03:17,500 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/883713553ed14631818432d4d6d89118, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:17,501 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/.tmp/f2/2e73d7801cbb42a788b0fa86b67f52d5 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/2e73d7801cbb42a788b0fa86b67f52d5 2023-02-12 00:03:17,503 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/4773e68665e44c4d909ae8142e605d81, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,504 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f2/7f3c07b0ac2a468eb463f229a0fcfc9f 2023-02-12 00:03:17,505 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e4e4e99323e1ae6220f2d9709d4a6171 in 128ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,505 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e4e4e99323e1ae6220f2d9709d4a6171: 2023-02-12 00:03:17,505 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:17,505 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:17,505 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:17,505 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. started... 2023-02-12 00:03:17,505 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6b2bd708e1adbbd9e939e594458371f3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,510 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/1aad057ea2d444e28bfc3fca779907be, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:17,511 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/.tmp/f2/1a0ea6dbb2024891a491c1eb3bd01aaa as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/1a0ea6dbb2024891a491c1eb3bd01aaa 2023-02-12 00:03:17,514 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/2e73d7801cbb42a788b0fa86b67f52d5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:17,515 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 9adf18cc115e5eebdd407b3a7640ea97 in 139ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,515 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9adf18cc115e5eebdd407b3a7640ea97: 2023-02-12 00:03:17,515 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:17,515 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:17,528 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/1a0ea6dbb2024891a491c1eb3bd01aaa, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:17,529 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f1/7528ba75255043869abce4d3cb5165d1 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/7528ba75255043869abce4d3cb5165d1 2023-02-12 00:03:17,529 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 307c756c745df0facbca059cf3516056 in 153ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,529 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 307c756c745df0facbca059cf3516056: 2023-02-12 00:03:17,529 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:17,529 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:17,529 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:17,529 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. started... 2023-02-12 00:03:17,530 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 745573e545c8759c84e229997b4340d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:17,534 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/7528ba75255043869abce4d3cb5165d1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,535 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/.tmp/f2/7f3c07b0ac2a468eb463f229a0fcfc9f as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/7f3c07b0ac2a468eb463f229a0fcfc9f 2023-02-12 00:03:17,540 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/7f3c07b0ac2a468eb463f229a0fcfc9f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,541 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8a319fc5ab773730c7fa584f461469f in 169ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,542 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f8a319fc5ab773730c7fa584f461469f: 2023-02-12 00:03:17,542 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:17,542 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:17,551 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f1/062488b2db874f2ab739e4b0be4d2c6e 2023-02-12 00:03:17,571 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f1/d6153bc7c55345bba846f0953d054a72 2023-02-12 00:03:17,587 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f2/2b0e3b61b6054b5dbc871458331fea73 2023-02-12 00:03:17,592 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f1/062488b2db874f2ab739e4b0be4d2c6e as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/062488b2db874f2ab739e4b0be4d2c6e 2023-02-12 00:03:17,597 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/062488b2db874f2ab739e4b0be4d2c6e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,598 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/.tmp/f2/2b0e3b61b6054b5dbc871458331fea73 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/2b0e3b61b6054b5dbc871458331fea73 2023-02-12 00:03:17,602 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f2/84bcd57cf55e4fe9a9c2175828172b26 2023-02-12 00:03:17,604 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/2b0e3b61b6054b5dbc871458331fea73, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,605 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6b2bd708e1adbbd9e939e594458371f3 in 100ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,606 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6b2bd708e1adbbd9e939e594458371f3: 2023-02-12 00:03:17,606 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:17,606 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:17,607 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f1/d6153bc7c55345bba846f0953d054a72 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/d6153bc7c55345bba846f0953d054a72 2023-02-12 00:03:17,612 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/d6153bc7c55345bba846f0953d054a72, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,612 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/.tmp/f2/84bcd57cf55e4fe9a9c2175828172b26 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/84bcd57cf55e4fe9a9c2175828172b26 2023-02-12 00:03:17,617 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/84bcd57cf55e4fe9a9c2175828172b26, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,618 INFO [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 745573e545c8759c84e229997b4340d5 in 88ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,618 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 745573e545c8759c84e229997b4340d5: 2023-02-12 00:03:17,618 DEBUG [rs(jenkins-hbase9.apache.org,43729,1676160193014)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:17,618 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:17,618 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:17,618 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,618 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:17,618 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43729,1676160193014' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:17,620 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,620 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:17,621 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,621 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:17,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43729,1676160193014' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 00:03:17,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e1877f8[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:17,829 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f1/b1779453c7b24c898e7f010cfc9d880b 2023-02-12 00:03:17,846 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f2/dfca351f11944ac3b644e4b83bb97628 2023-02-12 00:03:17,851 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f1/b1779453c7b24c898e7f010cfc9d880b as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/b1779453c7b24c898e7f010cfc9d880b 2023-02-12 00:03:17,855 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/b1779453c7b24c898e7f010cfc9d880b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,856 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/.tmp/f2/dfca351f11944ac3b644e4b83bb97628 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/dfca351f11944ac3b644e4b83bb97628 2023-02-12 00:03:17,861 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/dfca351f11944ac3b644e4b83bb97628, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,862 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d557477c9f6c230e14d9cb66e67a5dc4 in 484ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,862 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d557477c9f6c230e14d9cb66e67a5dc4: 2023-02-12 00:03:17,862 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:17,862 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:17,871 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f2/1e1759a6c18c445fabf51bf0e4e5b073 2023-02-12 00:03:17,876 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f1/e4d3aa1eba5348b6aa4ff837a8e60b9e as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/e4d3aa1eba5348b6aa4ff837a8e60b9e 2023-02-12 00:03:17,881 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/e4d3aa1eba5348b6aa4ff837a8e60b9e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,881 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/.tmp/f2/1e1759a6c18c445fabf51bf0e4e5b073 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/1e1759a6c18c445fabf51bf0e4e5b073 2023-02-12 00:03:17,886 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/1e1759a6c18c445fabf51bf0e4e5b073, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:17,887 INFO [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e7c0c86859ac5120f0deac2333ce7920 in 507ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:17,887 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e7c0c86859ac5120f0deac2333ce7920: 2023-02-12 00:03:17,887 DEBUG [rs(jenkins-hbase9.apache.org,43357,1676160193060)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:17,887 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:17,887 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:17,887 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,887 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:17,887 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43357,1676160193060' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:17,889 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,889 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:17,889 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,889 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:17,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43357,1676160193060' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 00:03:17,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e1877f8[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:17,891 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 00:03:17,891 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,893 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:17,894 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,894 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:17,894 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,43357,1676160193060' in zk 2023-02-12 00:03:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,894 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:17,894 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:17,894 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,43729,1676160193014' in zk 2023-02-12 00:03:17,894 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,894 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:17,895 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:17,895 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:17,895 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,895 DEBUG [member: 'jenkins-hbase9.apache.org,43357,1676160193060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:17,896 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:17,896 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,896 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:17,896 DEBUG [member: 'jenkins-hbase9.apache.org,43729,1676160193014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,43357,1676160193060': 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43357,1676160193060' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,43729,1676160193014': 2023-02-12 00:03:17,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43729,1676160193014' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 00:03:17,902 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 00:03:17,902 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:17,902 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:17,902 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 00:03:17,902 INFO [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:17,904 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:17,904 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:17,904 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,904 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:17,905 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:17,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,905 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,907 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:17,907 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,911 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:17,911 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:17,912 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:17,912 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:17,912 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,912 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 00:03:17,912 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:17,912 DEBUG [(jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:17,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:17,912 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:17,912 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:17,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:17,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:17,913 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:17,914 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:18,013 DEBUG [Listener at localhost/42847] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40739] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:18,015 INFO [Listener at localhost/42847] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:18,016 DEBUG [Listener at localhost/42847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f271f07 to 127.0.0.1:55516 2023-02-12 00:03:18,016 DEBUG [Listener at localhost/42847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,016 DEBUG [Listener at localhost/42847] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:18,016 DEBUG [Listener at localhost/42847] util.JVMClusterUtil(257): Found active master hash=632844039, stopped=false 2023-02-12 00:03:18,016 INFO [Listener at localhost/42847] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:18,018 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:18,018 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:18,018 INFO [Listener at localhost/42847] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:18,018 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:18,018 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:18,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:18,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:18,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:18,020 DEBUG [Listener at localhost/42847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d2d6d4b to 127.0.0.1:55516 2023-02-12 00:03:18,020 DEBUG [Listener at localhost/42847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,020 INFO [Listener at localhost/42847] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,43729,1676160193014' ***** 2023-02-12 00:03:18,020 INFO [Listener at localhost/42847] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:18,020 INFO [Listener at localhost/42847] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,43357,1676160193060' ***** 2023-02-12 00:03:18,020 INFO [Listener at localhost/42847] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:18,020 INFO [RS:0;jenkins-hbase9:43729] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:18,020 INFO [RS:0;jenkins-hbase9:43729] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:18,021 INFO [RS:0;jenkins-hbase9:43729] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:18,021 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for 00b19ae01701bbe03d465ebfa714e2fe 2023-02-12 00:03:18,021 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:18,021 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:18,021 INFO [RS:1;jenkins-hbase9:43357] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:18,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 00b19ae01701bbe03d465ebfa714e2fe, disabling compactions & flushes 2023-02-12 00:03:18,022 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:18,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:18,021 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:18,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:18,023 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for 307c756c745df0facbca059cf3516056 2023-02-12 00:03:18,022 INFO [RS:1;jenkins-hbase9:43357] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:18,023 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:18,023 INFO [RS:1;jenkins-hbase9:43357] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:18,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. after waiting 0 ms 2023-02-12 00:03:18,023 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:18,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:18,023 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(3304): Received CLOSE for 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:18,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 00b19ae01701bbe03d465ebfa714e2fe 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:18,023 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:18,023 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:18,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 9adf18cc115e5eebdd407b3a7640ea97, disabling compactions & flushes 2023-02-12 00:03:18,024 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:18,023 DEBUG [RS:0;jenkins-hbase9:43729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5143c77e to 127.0.0.1:55516 2023-02-12 00:03:18,024 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:18,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,024 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:18,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,024 DEBUG [RS:0;jenkins-hbase9:43729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. after waiting 0 ms 2023-02-12 00:03:18,024 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:18,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,024 DEBUG [RS:1;jenkins-hbase9:43357] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ac765f to 127.0.0.1:55516 2023-02-12 00:03:18,024 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 00:03:18,024 DEBUG [RS:1;jenkins-hbase9:43357] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,024 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1479): Online Regions={00b19ae01701bbe03d465ebfa714e2fe=hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe., f8a319fc5ab773730c7fa584f461469f=testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f., e4e4e99323e1ae6220f2d9709d4a6171=testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171., 307c756c745df0facbca059cf3516056=testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056., 6b2bd708e1adbbd9e939e594458371f3=testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3., 745573e545c8759c84e229997b4340d5=testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.} 2023-02-12 00:03:18,024 INFO [RS:1;jenkins-hbase9:43357] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:18,025 INFO [RS:1;jenkins-hbase9:43357] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:18,025 INFO [RS:1;jenkins-hbase9:43357] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:18,025 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:18,025 DEBUG [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1505): Waiting on 00b19ae01701bbe03d465ebfa714e2fe, 307c756c745df0facbca059cf3516056, 6b2bd708e1adbbd9e939e594458371f3, 745573e545c8759c84e229997b4340d5, e4e4e99323e1ae6220f2d9709d4a6171, f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:18,026 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 00:03:18,026 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1479): Online Regions={9adf18cc115e5eebdd407b3a7640ea97=testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97., 70540f7a4e3335b30ef110a69ea53ce5=testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5., 356540f3b3883ee20044031e07aff84d=testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d., d557477c9f6c230e14d9cb66e67a5dc4=testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4., e7c0c86859ac5120f0deac2333ce7920=testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 00:03:18,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:18,027 DEBUG [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1505): Waiting on 1588230740, 356540f3b3883ee20044031e07aff84d, 70540f7a4e3335b30ef110a69ea53ce5, 9adf18cc115e5eebdd407b3a7640ea97, d557477c9f6c230e14d9cb66e67a5dc4, e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:18,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:18,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:18,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:18,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:18,029 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-12 00:03:18,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 9adf18cc115e5eebdd407b3a7640ea97: Waiting for close lock at 1676160198023Running coprocessor pre-close hooks at 1676160198023Disabling compacts and flushes for region at 1676160198023Disabling writes for close at 1676160198024 (+1 ms)Writing region close event to WAL at 1676160198032 (+8 ms)Running coprocessor post-close hooks at 1676160198036 (+4 ms)Closed at 1676160198037 (+1 ms) 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 70540f7a4e3335b30ef110a69ea53ce5, disabling compactions & flushes 2023-02-12 00:03:18,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. after waiting 0 ms 2023-02-12 00:03:18,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/.tmp/info/b7283cac49f044488781ad72a8b6d96b 2023-02-12 00:03:18,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/.tmp/info/3c171fcc2d664760bc10919b6a5f9875 2023-02-12 00:03:18,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:18,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 70540f7a4e3335b30ef110a69ea53ce5: Waiting for close lock at 1676160198037Running coprocessor pre-close hooks at 1676160198037Disabling compacts and flushes for region at 1676160198037Disabling writes for close at 1676160198037Writing region close event to WAL at 1676160198037Running coprocessor post-close hooks at 1676160198046 (+9 ms)Closed at 1676160198047 (+1 ms) 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 356540f3b3883ee20044031e07aff84d, disabling compactions & flushes 2023-02-12 00:03:18,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. after waiting 0 ms 2023-02-12 00:03:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:18,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/.tmp/info/b7283cac49f044488781ad72a8b6d96b as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/info/b7283cac49f044488781ad72a8b6d96b 2023-02-12 00:03:18,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:18,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:18,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 356540f3b3883ee20044031e07aff84d: Waiting for close lock at 1676160198047Running coprocessor pre-close hooks at 1676160198047Disabling compacts and flushes for region at 1676160198047Disabling writes for close at 1676160198047Writing region close event to WAL at 1676160198047Running coprocessor post-close hooks at 1676160198052 (+5 ms)Closed at 1676160198052 2023-02-12 00:03:18,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:18,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d557477c9f6c230e14d9cb66e67a5dc4, disabling compactions & flushes 2023-02-12 00:03:18,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. after waiting 0 ms 2023-02-12 00:03:18,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/info/b7283cac49f044488781ad72a8b6d96b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:18,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 00b19ae01701bbe03d465ebfa714e2fe in 37ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:18,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 00:03:18,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/.tmp/table/7b87add589124bd7805e59b41224ac04 2023-02-12 00:03:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/namespace/00b19ae01701bbe03d465ebfa714e2fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d557477c9f6c230e14d9cb66e67a5dc4: Waiting for close lock at 1676160198053Running coprocessor pre-close hooks at 1676160198053Disabling compacts and flushes for region at 1676160198053Disabling writes for close at 1676160198053Writing region close event to WAL at 1676160198068 (+15 ms)Running coprocessor post-close hooks at 1676160198072 (+4 ms)Closed at 1676160198072 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e7c0c86859ac5120f0deac2333ce7920, disabling compactions & flushes 2023-02-12 00:03:18,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. after waiting 0 ms 2023-02-12 00:03:18,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 00b19ae01701bbe03d465ebfa714e2fe: Waiting for close lock at 1676160198021Running coprocessor pre-close hooks at 1676160198021Disabling compacts and flushes for region at 1676160198021Disabling writes for close at 1676160198023 (+2 ms)Obtaining lock to block concurrent updates at 1676160198023Preparing flush snapshotting stores in 00b19ae01701bbe03d465ebfa714e2fe at 1676160198023Finished memstore snapshotting hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160198024 (+1 ms)Flushing stores of hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. at 1676160198024Flushing 00b19ae01701bbe03d465ebfa714e2fe/info: creating writer at 1676160198024Flushing 00b19ae01701bbe03d465ebfa714e2fe/info: appending metadata at 1676160198032 (+8 ms)Flushing 00b19ae01701bbe03d465ebfa714e2fe/info: closing flushed file at 1676160198032Flushing 00b19ae01701bbe03d465ebfa714e2fe/info: reopening flushed file at 1676160198050 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 00b19ae01701bbe03d465ebfa714e2fe in 37ms, sequenceid=6, compaction requested=false at 1676160198060 (+10 ms)Writing region close event to WAL at 1676160198068 (+8 ms)Running coprocessor post-close hooks at 1676160198073 (+5 ms)Closed at 1676160198074 (+1 ms) 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160193811.00b19ae01701bbe03d465ebfa714e2fe. 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f8a319fc5ab773730c7fa584f461469f, disabling compactions & flushes 2023-02-12 00:03:18,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. after waiting 0 ms 2023-02-12 00:03:18,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,085 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:18,085 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:18,087 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/.tmp/info/3c171fcc2d664760bc10919b6a5f9875 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/info/3c171fcc2d664760bc10919b6a5f9875 2023-02-12 00:03:18,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f8a319fc5ab773730c7fa584f461469f: Waiting for close lock at 1676160198074Running coprocessor pre-close hooks at 1676160198074Disabling compacts and flushes for region at 1676160198074Disabling writes for close at 1676160198074Writing region close event to WAL at 1676160198085 (+11 ms)Running coprocessor post-close hooks at 1676160198089 (+4 ms)Closed at 1676160198090 (+1 ms) 2023-02-12 00:03:18,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e7c0c86859ac5120f0deac2333ce7920: Waiting for close lock at 1676160198073Running coprocessor pre-close hooks at 1676160198073Disabling compacts and flushes for region at 1676160198073Disabling writes for close at 1676160198073Writing region close event to WAL at 1676160198083 (+10 ms)Running coprocessor post-close hooks at 1676160198090 (+7 ms)Closed at 1676160198090 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e4e4e99323e1ae6220f2d9709d4a6171, disabling compactions & flushes 2023-02-12 00:03:18,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. after waiting 0 ms 2023-02-12 00:03:18,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/info/3c171fcc2d664760bc10919b6a5f9875, entries=110, sequenceid=32, filesize=18.7 K 2023-02-12 00:03:18,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/.tmp/table/7b87add589124bd7805e59b41224ac04 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/table/7b87add589124bd7805e59b41224ac04 2023-02-12 00:03:18,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e4e4e99323e1ae6220f2d9709d4a6171: Waiting for close lock at 1676160198090Running coprocessor pre-close hooks at 1676160198090Disabling compacts and flushes for region at 1676160198090Disabling writes for close at 1676160198090Writing region close event to WAL at 1676160198092 (+2 ms)Running coprocessor post-close hooks at 1676160198095 (+3 ms)Closed at 1676160198097 (+2 ms) 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 307c756c745df0facbca059cf3516056, disabling compactions & flushes 2023-02-12 00:03:18,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. after waiting 0 ms 2023-02-12 00:03:18,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/table/7b87add589124bd7805e59b41224ac04, entries=4, sequenceid=32, filesize=4.8 K 2023-02-12 00:03:18,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=32, compaction requested=false 2023-02-12 00:03:18,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 307c756c745df0facbca059cf3516056: Waiting for close lock at 1676160198097Running coprocessor pre-close hooks at 1676160198097Disabling compacts and flushes for region at 1676160198097Disabling writes for close at 1676160198097Writing region close event to WAL at 1676160198098 (+1 ms)Running coprocessor post-close hooks at 1676160198102 (+4 ms)Closed at 1676160198102 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 6b2bd708e1adbbd9e939e594458371f3, disabling compactions & flushes 2023-02-12 00:03:18,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. after waiting 0 ms 2023-02-12 00:03:18,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-12 00:03:18,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:18,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 6b2bd708e1adbbd9e939e594458371f3: Waiting for close lock at 1676160198102Running coprocessor pre-close hooks at 1676160198102Disabling compacts and flushes for region at 1676160198102Disabling writes for close at 1676160198102Writing region close event to WAL at 1676160198106 (+4 ms)Running coprocessor post-close hooks at 1676160198110 (+4 ms)Closed at 1676160198110 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160198026Running coprocessor pre-close hooks at 1676160198026Disabling compacts and flushes for region at 1676160198026Disabling writes for close at 1676160198029 (+3 ms)Obtaining lock to block concurrent updates at 1676160198029Preparing flush snapshotting stores in 1588230740 at 1676160198029Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676160198030 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676160198032 (+2 ms)Flushing 1588230740/info: creating writer at 1676160198032Flushing 1588230740/info: appending metadata at 1676160198035 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676160198035Flushing 1588230740/table: creating writer at 1676160198050 (+15 ms)Flushing 1588230740/table: appending metadata at 1676160198053 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676160198053Flushing 1588230740/info: reopening flushed file at 1676160198088 (+35 ms)Flushing 1588230740/table: reopening flushed file at 1676160198097 (+9 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=32, compaction requested=false at 1676160198102 (+5 ms)Writing region close event to WAL at 1676160198105 (+3 ms)Running coprocessor post-close hooks at 1676160198110 (+5 ms)Closed at 1676160198110 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 745573e545c8759c84e229997b4340d5, disabling compactions & flushes 2023-02-12 00:03:18,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. after waiting 0 ms 2023-02-12 00:03:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:18,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 745573e545c8759c84e229997b4340d5: Waiting for close lock at 1676160198110Running coprocessor pre-close hooks at 1676160198110Disabling compacts and flushes for region at 1676160198110Disabling writes for close at 1676160198110Writing region close event to WAL at 1676160198111 (+1 ms)Running coprocessor post-close hooks at 1676160198115 (+4 ms)Closed at 1676160198115 2023-02-12 00:03:18,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,225 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,43729,1676160193014; all regions closed. 2023-02-12 00:03:18,229 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,43357,1676160193060; all regions closed. 2023-02-12 00:03:18,232 DEBUG [RS:0;jenkins-hbase9:43729] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs 2023-02-12 00:03:18,232 INFO [RS:0;jenkins-hbase9:43729] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43729%2C1676160193014:(num 1676160194221) 2023-02-12 00:03:18,232 DEBUG [RS:0;jenkins-hbase9:43729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,232 INFO [RS:0;jenkins-hbase9:43729] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:18,232 INFO [RS:0;jenkins-hbase9:43729] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:18,233 INFO [RS:0;jenkins-hbase9:43729] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:18,233 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:18,233 INFO [RS:0;jenkins-hbase9:43729] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:18,233 INFO [RS:0;jenkins-hbase9:43729] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:18,234 INFO [RS:0;jenkins-hbase9:43729] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43729 2023-02-12 00:03:18,238 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:18,238 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43729,1676160193014 2023-02-12 00:03:18,238 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72f391e rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,238 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:18,238 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:18,239 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@987afea rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,239 DEBUG [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs 2023-02-12 00:03:18,238 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:18,239 INFO [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43357%2C1676160193060.meta:.meta(num 1676160193721) 2023-02-12 00:03:18,240 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43729,1676160193014] 2023-02-12 00:03:18,240 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43729,1676160193014; numProcessing=1 2023-02-12 00:03:18,244 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43729,1676160193014 already deleted, retry=false 2023-02-12 00:03:18,244 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43729,1676160193014 expired; onlineServers=1 2023-02-12 00:03:18,249 DEBUG [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/oldWALs 2023-02-12 00:03:18,249 INFO [RS:1;jenkins-hbase9:43357] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43357%2C1676160193060:(num 1676160194446) 2023-02-12 00:03:18,249 DEBUG [RS:1;jenkins-hbase9:43357] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,249 INFO [RS:1;jenkins-hbase9:43357] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:18,249 INFO [RS:1;jenkins-hbase9:43357] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:18,250 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:18,250 INFO [RS:1;jenkins-hbase9:43357] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43357 2023-02-12 00:03:18,253 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43357,1676160193060 2023-02-12 00:03:18,253 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:18,253 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bd7a430 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,254 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43357,1676160193060] 2023-02-12 00:03:18,254 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43357,1676160193060; numProcessing=2 2023-02-12 00:03:18,255 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43357,1676160193060 already deleted, retry=false 2023-02-12 00:03:18,255 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43357,1676160193060 expired; onlineServers=0 2023-02-12 00:03:18,255 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,40739,1676160192924' ***** 2023-02-12 00:03:18,255 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:18,256 DEBUG [M:0;jenkins-hbase9:40739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6485653c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:18,256 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,40739,1676160192924 2023-02-12 00:03:18,256 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,40739,1676160192924; all regions closed. 2023-02-12 00:03:18,256 DEBUG [M:0;jenkins-hbase9:40739] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:18,256 DEBUG [M:0;jenkins-hbase9:40739] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:18,256 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:18,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160193286] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160193286,5,FailOnTimeoutGroup] 2023-02-12 00:03:18,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160193286] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160193286,5,FailOnTimeoutGroup] 2023-02-12 00:03:18,256 DEBUG [M:0;jenkins-hbase9:40739] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:18,258 INFO [M:0;jenkins-hbase9:40739] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:18,258 INFO [M:0;jenkins-hbase9:40739] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:18,258 INFO [M:0;jenkins-hbase9:40739] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:18,259 DEBUG [M:0;jenkins-hbase9:40739] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:18,259 INFO [M:0;jenkins-hbase9:40739] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:18,259 ERROR [M:0;jenkins-hbase9:40739] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:18,259 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:18,259 INFO [M:0;jenkins-hbase9:40739] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:18,259 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:18,259 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:18,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:18,260 DEBUG [M:0;jenkins-hbase9:40739] zookeeper.ZKUtil(398): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:18,260 WARN [M:0;jenkins-hbase9:40739] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:18,260 INFO [M:0;jenkins-hbase9:40739] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:18,260 INFO [M:0;jenkins-hbase9:40739] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:18,260 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:18,260 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:18,260 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:18,260 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:18,260 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:18,261 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-12 00:03:18,270 INFO [M:0;jenkins-hbase9:40739] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5ebd6194cf2c4cd8bc9ab008551338f8 2023-02-12 00:03:18,275 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5ebd6194cf2c4cd8bc9ab008551338f8 as hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5ebd6194cf2c4cd8bc9ab008551338f8 2023-02-12 00:03:18,279 INFO [M:0;jenkins-hbase9:40739] regionserver.HStore(1080): Added hdfs://localhost:38083/user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5ebd6194cf2c4cd8bc9ab008551338f8, entries=31, sequenceid=218, filesize=9.0 K 2023-02-12 00:03:18,280 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-12 00:03:18,281 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:18,281 DEBUG [M:0;jenkins-hbase9:40739] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160198260Disabling compacts and flushes for region at 1676160198260Disabling writes for close at 1676160198260Obtaining lock to block concurrent updates at 1676160198261 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160198261Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676160198261Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160198262 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160198262Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160198264 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160198264Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160198275 (+11 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1676160198280 (+5 ms)Writing region close event to WAL at 1676160198281 (+1 ms)Closed at 1676160198281 2023-02-12 00:03:18,289 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1e749ef2-a8cd-09a4-ef17-03e32b94156d/MasterData/WALs/jenkins-hbase9.apache.org,40739,1676160192924/jenkins-hbase9.apache.org%2C40739%2C1676160192924.1676160193183 not finished, retry = 0 2023-02-12 00:03:18,390 INFO [M:0;jenkins-hbase9:40739] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:18,390 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:18,391 INFO [M:0;jenkins-hbase9:40739] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40739 2023-02-12 00:03:18,394 DEBUG [M:0;jenkins-hbase9:40739] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,40739,1676160192924 already deleted, retry=false 2023-02-12 00:03:18,518 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,518 INFO [M:0;jenkins-hbase9:40739] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,40739,1676160192924; zookeeper connection closed. 2023-02-12 00:03:18,518 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4080ee28 rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,519 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): master:40739-0x10045d7b1560000, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,519 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7740663d rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,619 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,619 INFO [RS:1;jenkins-hbase9:43357] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,43357,1676160193060; zookeeper connection closed. 2023-02-12 00:03:18,619 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4daaaaec rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,619 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@efd4fc6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@efd4fc6 2023-02-12 00:03:18,619 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43357-0x10045d7b1560002, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,619 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35502b13 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,719 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,719 INFO [RS:0;jenkins-hbase9:43729] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,43729,1676160193014; zookeeper connection closed. 2023-02-12 00:03:18,719 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71e15268 rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,719 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@583bf597] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@583bf597 2023-02-12 00:03:18,719 DEBUG [Listener at localhost/42847-EventThread] zookeeper.ZKWatcher(600): regionserver:43729-0x10045d7b1560001, quorum=127.0.0.1:55516, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:18,719 ERROR [Listener at localhost/42847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1271cfb8 rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:18,720 INFO [Listener at localhost/42847] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:18,806 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop-5805910233400651445.jar 2023-02-12 00:03:18,811 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676160195719 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:18,811 DEBUG [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce 2023-02-12 00:03:18,811 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 307c756c745df0facbca059cf3516056 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(239): region to add: 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=70540f7a4e3335b30ef110a69ea53ce5 as 70540f7a4e3335b30ef110a69ea53ce5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=f8a319fc5ab773730c7fa584f461469f as f8a319fc5ab773730c7fa584f461469f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=9adf18cc115e5eebdd407b3a7640ea97 as 9adf18cc115e5eebdd407b3a7640ea97 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=307c756c745df0facbca059cf3516056 as 307c756c745df0facbca059cf3516056 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=356540f3b3883ee20044031e07aff84d as 356540f3b3883ee20044031e07aff84d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=e4e4e99323e1ae6220f2d9709d4a6171 as e4e4e99323e1ae6220f2d9709d4a6171 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,812 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=6b2bd708e1adbbd9e939e594458371f3 as 6b2bd708e1adbbd9e939e594458371f3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,813 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=d557477c9f6c230e14d9cb66e67a5dc4 as d557477c9f6c230e14d9cb66e67a5dc4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,813 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=e7c0c86859ac5120f0deac2333ce7920 as e7c0c86859ac5120f0deac2333ce7920 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,813 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(585): clone region=745573e545c8759c84e229997b4340d5 as 745573e545c8759c84e229997b4340d5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 00:03:18,814 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e4e4e99323e1ae6220f2d9709d4a6171, NAME => 'testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,814 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 70540f7a4e3335b30ef110a69ea53ce5, NAME => 'testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 356540f3b3883ee20044031e07aff84d, NAME => 'testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9adf18cc115e5eebdd407b3a7640ea97, NAME => 'testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 6b2bd708e1adbbd9e939e594458371f3, NAME => 'testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => d557477c9f6c230e14d9cb66e67a5dc4, NAME => 'testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 307c756c745df0facbca059cf3516056, NAME => 'testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,815 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f8a319fc5ab773730c7fa584f461469f, NAME => 'testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,847 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,847 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,848 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9cc5a364172648888ce14d76865098af from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,848 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60e410481936404f954085e8e20f8a2b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,848 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 70540f7a4e3335b30ef110a69ea53ce5, disabling compactions & flushes 2023-02-12 00:03:18,848 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,848 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,848 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. after waiting 0 ms 2023-02-12 00:03:18,848 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,848 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:18,848 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 70540f7a4e3335b30ef110a69ea53ce5: Waiting for close lock at 1676160198848Disabling compacts and flushes for region at 1676160198848Disabling writes for close at 1676160198848Writing region close event to WAL at 1676160198848Closed at 1676160198848 2023-02-12 00:03:18,849 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7c0c86859ac5120f0deac2333ce7920, NAME => 'testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,859 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6385afa95246453eb5fabfa0a9a18033 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,859 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9a3ba65ca624e31962571116688436d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,862 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,862 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fbc53c06dbd943419f728a7181162a20 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f8a319fc5ab773730c7fa584f461469f, disabling compactions & flushes 2023-02-12 00:03:18,863 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. after waiting 0 ms 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,863 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:18,863 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0def055afc346c599d8c0fa5de4e233 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,863 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f8a319fc5ab773730c7fa584f461469f: Waiting for close lock at 1676160198863Disabling compacts and flushes for region at 1676160198863Disabling writes for close at 1676160198863Writing region close event to WAL at 1676160198863Closed at 1676160198863 2023-02-12 00:03:18,864 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 745573e545c8759c84e229997b4340d5, NAME => 'testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e4e4e99323e1ae6220f2d9709d4a6171, disabling compactions & flushes 2023-02-12 00:03:18,875 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. after waiting 0 ms 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,875 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e4e4e99323e1ae6220f2d9709d4a6171: Waiting for close lock at 1676160198875Disabling compacts and flushes for region at 1676160198875Disabling writes for close at 1676160198875Writing region close event to WAL at 1676160198875Closed at 1676160198875 2023-02-12 00:03:18,875 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,876 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 567d70e66f4742b89a982822f55c7ec3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,876 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d33454dff3b74a2d80d63f964af25d3b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,876 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3206f91f973d4fbb969f927896629256 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,876 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,876 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 70e4062d440e4ff8908ea3b83ff8c1e1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,878 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,878 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de540c4286054a978de31cfae9a85563 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,879 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 6b2bd708e1adbbd9e939e594458371f3, disabling compactions & flushes 2023-02-12 00:03:18,879 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,879 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,879 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. after waiting 0 ms 2023-02-12 00:03:18,879 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,879 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:18,879 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 6b2bd708e1adbbd9e939e594458371f3: Waiting for close lock at 1676160198879Disabling compacts and flushes for region at 1676160198879Disabling writes for close at 1676160198879Writing region close event to WAL at 1676160198879Closed at 1676160198879 2023-02-12 00:03:18,887 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3068f60904cb46d0a4c57e0b051fc923 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,887 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:18,887 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ffd531d314b9432483961db69dbf9232 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,887 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94bdbea852d0454e8802a1bc2022ed19 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,888 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing d557477c9f6c230e14d9cb66e67a5dc4, disabling compactions & flushes 2023-02-12 00:03:18,888 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,888 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,888 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. after waiting 0 ms 2023-02-12 00:03:18,888 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,888 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:18,888 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for d557477c9f6c230e14d9cb66e67a5dc4: Waiting for close lock at 1676160198888Disabling compacts and flushes for region at 1676160198888Disabling writes for close at 1676160198888Writing region close event to WAL at 1676160198888Closed at 1676160198888 2023-02-12 00:03:18,889 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66b30810d838430490896678377a03f1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,891 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68147d3c69094e35a2d7e5794b5e3895 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 00:03:18,893 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 307c756c745df0facbca059cf3516056, disabling compactions & flushes 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. after waiting 0 ms 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e7c0c86859ac5120f0deac2333ce7920, disabling compactions & flushes 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 307c756c745df0facbca059cf3516056: Waiting for close lock at 1676160198893Disabling compacts and flushes for region at 1676160198893Disabling writes for close at 1676160198894 (+1 ms)Writing region close event to WAL at 1676160198894Closed at 1676160198894 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. after waiting 0 ms 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e7c0c86859ac5120f0deac2333ce7920: Waiting for close lock at 1676160198894Disabling compacts and flushes for region at 1676160198894Disabling writes for close at 1676160198894Writing region close event to WAL at 1676160198894Closed at 1676160198894 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 9adf18cc115e5eebdd407b3a7640ea97, disabling compactions & flushes 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 745573e545c8759c84e229997b4340d5, disabling compactions & flushes 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,894 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,894 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. after waiting 0 ms 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. after waiting 0 ms 2023-02-12 00:03:18,895 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 745573e545c8759c84e229997b4340d5: Waiting for close lock at 1676160198894Disabling compacts and flushes for region at 1676160198894Disabling writes for close at 1676160198895 (+1 ms)Writing region close event to WAL at 1676160198895Closed at 1676160198895 2023-02-12 00:03:18,895 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:18,895 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 9adf18cc115e5eebdd407b3a7640ea97: Waiting for close lock at 1676160198894Disabling compacts and flushes for region at 1676160198894Disabling writes for close at 1676160198895 (+1 ms)Writing region close event to WAL at 1676160198895Closed at 1676160198895 2023-02-12 00:03:19,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:19,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 356540f3b3883ee20044031e07aff84d, disabling compactions & flushes 2023-02-12 00:03:19,266 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:19,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:19,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. after waiting 0 ms 2023-02-12 00:03:19,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:19,266 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:19,267 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 356540f3b3883ee20044031e07aff84d: Waiting for close lock at 1676160199266Disabling compacts and flushes for region at 1676160199266Disabling writes for close at 1676160199266Writing region close event to WAL at 1676160199266Closed at 1676160199266 2023-02-12 00:03:19,267 INFO [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676160195719 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:19,267 DEBUG [Listener at localhost/42847] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:19,267 DEBUG [Listener at localhost/42847] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619 2023-02-12 00:03:19,268 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:19,269 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:19,269 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 00:03:19,270 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------307c756c745df0facbca059cf3516056/ 2023-02-12 00:03:19,270 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,270 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,271 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=307c756c745df0facbca059cf3516056-567d70e66f4742b89a982822f55c7ec3 2023-02-12 00:03:19,271 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,272 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=307c756c745df0facbca059cf3516056-3068f60904cb46d0a4c57e0b051fc923 2023-02-12 00:03:19,272 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------356540f3b3883ee20044031e07aff84d/ 2023-02-12 00:03:19,272 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,272 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------6b2bd708e1adbbd9e939e594458371f3/ 2023-02-12 00:03:19,273 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,273 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,273 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=6b2bd708e1adbbd9e939e594458371f3-f0def055afc346c599d8c0fa5de4e233 2023-02-12 00:03:19,274 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,274 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=6b2bd708e1adbbd9e939e594458371f3-3206f91f973d4fbb969f927896629256 2023-02-12 00:03:19,274 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------70540f7a4e3335b30ef110a69ea53ce5/ 2023-02-12 00:03:19,275 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,275 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------745573e545c8759c84e229997b4340d5/ 2023-02-12 00:03:19,275 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,275 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,276 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=745573e545c8759c84e229997b4340d5-ffd531d314b9432483961db69dbf9232 2023-02-12 00:03:19,276 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,277 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=745573e545c8759c84e229997b4340d5-68147d3c69094e35a2d7e5794b5e3895 2023-02-12 00:03:19,277 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------9adf18cc115e5eebdd407b3a7640ea97/ 2023-02-12 00:03:19,277 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,277 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,278 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=9adf18cc115e5eebdd407b3a7640ea97-de540c4286054a978de31cfae9a85563 2023-02-12 00:03:19,278 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,278 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=9adf18cc115e5eebdd407b3a7640ea97-66b30810d838430490896678377a03f1 2023-02-12 00:03:19,278 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------d557477c9f6c230e14d9cb66e67a5dc4/ 2023-02-12 00:03:19,279 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,279 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,280 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=d557477c9f6c230e14d9cb66e67a5dc4-fbc53c06dbd943419f728a7181162a20 2023-02-12 00:03:19,280 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,280 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=d557477c9f6c230e14d9cb66e67a5dc4-d33454dff3b74a2d80d63f964af25d3b 2023-02-12 00:03:19,280 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------e4e4e99323e1ae6220f2d9709d4a6171/ 2023-02-12 00:03:19,281 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,281 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,281 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=e4e4e99323e1ae6220f2d9709d4a6171-60e410481936404f954085e8e20f8a2b 2023-02-12 00:03:19,281 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,282 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=e4e4e99323e1ae6220f2d9709d4a6171-d9a3ba65ca624e31962571116688436d 2023-02-12 00:03:19,282 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------e7c0c86859ac5120f0deac2333ce7920/ 2023-02-12 00:03:19,282 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,282 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,283 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=e7c0c86859ac5120f0deac2333ce7920-70e4062d440e4ff8908ea3b83ff8c1e1 2023-02-12 00:03:19,283 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,283 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=e7c0c86859ac5120f0deac2333ce7920-94bdbea852d0454e8802a1bc2022ed19 2023-02-12 00:03:19,283 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |----------f8a319fc5ab773730c7fa584f461469f/ 2023-02-12 00:03:19,284 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:19,284 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:19,284 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=f8a319fc5ab773730c7fa584f461469f-9cc5a364172648888ce14d76865098af 2023-02-12 00:03:19,284 DEBUG [Listener at localhost/42847] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:19,284 DEBUG [Listener at localhost/42847] util.CommonFSUtils(702): |----------------testWithMapReduce=f8a319fc5ab773730c7fa584f461469f-6385afa95246453eb5fabfa0a9a18033 2023-02-12 00:03:19,285 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:19,285 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:19,286 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:19,286 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,224 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop-1587818962566415066.jar 2023-02-12 00:03:20,225 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,225 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,302 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop-6016004433295435191.jar 2023-02-12 00:03:20,303 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,303 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,304 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,304 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,305 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,306 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,306 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 00:03:20,307 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 00:03:20,307 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 00:03:20,308 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 00:03:20,308 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 00:03:20,309 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 00:03:20,310 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 00:03:20,310 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 00:03:20,311 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 00:03:20,311 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 00:03:20,312 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:20,313 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:20,313 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:20,314 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:20,315 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:20,404 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop-3182809982164770723.jar 2023-02-12 00:03:20,405 DEBUG [Listener at localhost/42847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:20,413 WARN [Listener at localhost/42847] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 00:03:20,419 WARN [Listener at localhost/42847] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 00:03:20,426 INFO [Listener at localhost/42847] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 00:03:20,524 WARN [Listener at localhost/42847] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/mapreduce.cluster.local.dir/1676160200493/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 00:03:20,524 WARN [Listener at localhost/42847] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/mapreduce.cluster.local.dir/1676160200493/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 00:03:20,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,556 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,557 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,559 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 307c756c745df0facbca059cf3516056 2023-02-12 00:03:20,560 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1 2023-02-12 00:03:20,560 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307c756c745df0facbca059cf3516056 columnFamilyName f1 2023-02-12 00:03:20,567 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f1/testWithMapReduce=307c756c745df0facbca059cf3516056-567d70e66f4742b89a982822f55c7ec3 2023-02-12 00:03:20,567 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(310): Store=307c756c745df0facbca059cf3516056/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,567 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 307c756c745df0facbca059cf3516056 2023-02-12 00:03:20,568 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2 2023-02-12 00:03:20,568 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307c756c745df0facbca059cf3516056 columnFamilyName f2 2023-02-12 00:03:20,573 DEBUG [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/307c756c745df0facbca059cf3516056/f2/testWithMapReduce=307c756c745df0facbca059cf3516056-3068f60904cb46d0a4c57e0b051fc923 2023-02-12 00:03:20,573 INFO [StoreOpener-307c756c745df0facbca059cf3516056-1] regionserver.HStore(310): Store=307c756c745df0facbca059cf3516056/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,574 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 307c756c745df0facbca059cf3516056; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72287810, jitterRate=0.07717230916023254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 307c756c745df0facbca059cf3516056: Writing region info on filesystem at 1676160200557Initializing all the Stores at 1676160200558 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200558Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200558Region opened successfully at 1676160200574 (+16 ms) 2023-02-12 00:03:20,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 307c756c745df0facbca059cf3516056, disabling compactions & flushes 2023-02-12 00:03:20,608 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:20,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:20,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. after waiting 0 ms 2023-02-12 00:03:20,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:20,611 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676160194427.307c756c745df0facbca059cf3516056. 2023-02-12 00:03:20,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 307c756c745df0facbca059cf3516056: Waiting for close lock at 1676160200608Disabling compacts and flushes for region at 1676160200608Disabling writes for close at 1676160200608Writing region close event to WAL at 1676160200611 (+3 ms)Closed at 1676160200611 2023-02-12 00:03:20,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,615 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,616 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,618 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:20,619 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f1 2023-02-12 00:03:20,620 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 356540f3b3883ee20044031e07aff84d columnFamilyName f1 2023-02-12 00:03:20,620 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(310): Store=356540f3b3883ee20044031e07aff84d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,621 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 356540f3b3883ee20044031e07aff84d 2023-02-12 00:03:20,622 DEBUG [StoreOpener-356540f3b3883ee20044031e07aff84d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/356540f3b3883ee20044031e07aff84d/f2 2023-02-12 00:03:20,622 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 356540f3b3883ee20044031e07aff84d columnFamilyName f2 2023-02-12 00:03:20,623 INFO [StoreOpener-356540f3b3883ee20044031e07aff84d-1] regionserver.HStore(310): Store=356540f3b3883ee20044031e07aff84d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,623 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 356540f3b3883ee20044031e07aff84d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64027567, jitterRate=-0.0459149032831192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 356540f3b3883ee20044031e07aff84d: Writing region info on filesystem at 1676160200616Initializing all the Stores at 1676160200617 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200617Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200617Region opened successfully at 1676160200623 (+6 ms) 2023-02-12 00:03:20,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 356540f3b3883ee20044031e07aff84d, disabling compactions & flushes 2023-02-12 00:03:20,640 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:20,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:20,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. after waiting 0 ms 2023-02-12 00:03:20,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:20,640 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676160194427.356540f3b3883ee20044031e07aff84d. 2023-02-12 00:03:20,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 356540f3b3883ee20044031e07aff84d: Waiting for close lock at 1676160200640Disabling compacts and flushes for region at 1676160200640Disabling writes for close at 1676160200640Writing region close event to WAL at 1676160200640Closed at 1676160200640 2023-02-12 00:03:20,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,644 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,645 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,647 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:20,648 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1 2023-02-12 00:03:20,648 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b2bd708e1adbbd9e939e594458371f3 columnFamilyName f1 2023-02-12 00:03:20,654 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f1/testWithMapReduce=6b2bd708e1adbbd9e939e594458371f3-f0def055afc346c599d8c0fa5de4e233 2023-02-12 00:03:20,654 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(310): Store=6b2bd708e1adbbd9e939e594458371f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,654 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b2bd708e1adbbd9e939e594458371f3 2023-02-12 00:03:20,655 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2 2023-02-12 00:03:20,656 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b2bd708e1adbbd9e939e594458371f3 columnFamilyName f2 2023-02-12 00:03:20,660 DEBUG [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/6b2bd708e1adbbd9e939e594458371f3/f2/testWithMapReduce=6b2bd708e1adbbd9e939e594458371f3-3206f91f973d4fbb969f927896629256 2023-02-12 00:03:20,661 INFO [StoreOpener-6b2bd708e1adbbd9e939e594458371f3-1] regionserver.HStore(310): Store=6b2bd708e1adbbd9e939e594458371f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,661 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6b2bd708e1adbbd9e939e594458371f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70993652, jitterRate=0.05788785219192505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6b2bd708e1adbbd9e939e594458371f3: Writing region info on filesystem at 1676160200645Initializing all the Stores at 1676160200646 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200646Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200646Region opened successfully at 1676160200661 (+15 ms) 2023-02-12 00:03:20,692 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6b2bd708e1adbbd9e939e594458371f3, disabling compactions & flushes 2023-02-12 00:03:20,693 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:20,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:20,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. after waiting 0 ms 2023-02-12 00:03:20,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:20,695 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676160194427.6b2bd708e1adbbd9e939e594458371f3. 2023-02-12 00:03:20,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6b2bd708e1adbbd9e939e594458371f3: Waiting for close lock at 1676160200692Disabling compacts and flushes for region at 1676160200692Disabling writes for close at 1676160200693 (+1 ms)Writing region close event to WAL at 1676160200695 (+2 ms)Closed at 1676160200695 2023-02-12 00:03:20,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,698 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,703 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,704 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:20,705 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1 2023-02-12 00:03:20,706 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7c0c86859ac5120f0deac2333ce7920 columnFamilyName f1 2023-02-12 00:03:20,711 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f1/testWithMapReduce=e7c0c86859ac5120f0deac2333ce7920-70e4062d440e4ff8908ea3b83ff8c1e1 2023-02-12 00:03:20,711 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(310): Store=e7c0c86859ac5120f0deac2333ce7920/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,711 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7c0c86859ac5120f0deac2333ce7920 2023-02-12 00:03:20,712 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2 2023-02-12 00:03:20,712 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7c0c86859ac5120f0deac2333ce7920 columnFamilyName f2 2023-02-12 00:03:20,718 DEBUG [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e7c0c86859ac5120f0deac2333ce7920/f2/testWithMapReduce=e7c0c86859ac5120f0deac2333ce7920-94bdbea852d0454e8802a1bc2022ed19 2023-02-12 00:03:20,718 INFO [StoreOpener-e7c0c86859ac5120f0deac2333ce7920-1] regionserver.HStore(310): Store=e7c0c86859ac5120f0deac2333ce7920/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,719 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e7c0c86859ac5120f0deac2333ce7920; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69253704, jitterRate=0.03196060657501221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e7c0c86859ac5120f0deac2333ce7920: Writing region info on filesystem at 1676160200703Initializing all the Stores at 1676160200704 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200704Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200704Region opened successfully at 1676160200719 (+15 ms) 2023-02-12 00:03:20,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e7c0c86859ac5120f0deac2333ce7920, disabling compactions & flushes 2023-02-12 00:03:20,760 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:20,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:20,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. after waiting 0 ms 2023-02-12 00:03:20,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:20,761 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676160194427.e7c0c86859ac5120f0deac2333ce7920. 2023-02-12 00:03:20,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e7c0c86859ac5120f0deac2333ce7920: Waiting for close lock at 1676160200760Disabling compacts and flushes for region at 1676160200760Disabling writes for close at 1676160200760Writing region close event to WAL at 1676160200761 (+1 ms)Closed at 1676160200761 2023-02-12 00:03:20,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,764 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,765 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,768 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:20,769 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1 2023-02-12 00:03:20,769 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e4e99323e1ae6220f2d9709d4a6171 columnFamilyName f1 2023-02-12 00:03:20,774 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f1/testWithMapReduce=e4e4e99323e1ae6220f2d9709d4a6171-60e410481936404f954085e8e20f8a2b 2023-02-12 00:03:20,774 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(310): Store=e4e4e99323e1ae6220f2d9709d4a6171/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,775 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4e4e99323e1ae6220f2d9709d4a6171 2023-02-12 00:03:20,775 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2 2023-02-12 00:03:20,776 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4e4e99323e1ae6220f2d9709d4a6171 columnFamilyName f2 2023-02-12 00:03:20,781 DEBUG [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/e4e4e99323e1ae6220f2d9709d4a6171/f2/testWithMapReduce=e4e4e99323e1ae6220f2d9709d4a6171-d9a3ba65ca624e31962571116688436d 2023-02-12 00:03:20,781 INFO [StoreOpener-e4e4e99323e1ae6220f2d9709d4a6171-1] regionserver.HStore(310): Store=e4e4e99323e1ae6220f2d9709d4a6171/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,781 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,781 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e4e4e99323e1ae6220f2d9709d4a6171; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61632236, jitterRate=-0.0816081166267395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,781 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e4e4e99323e1ae6220f2d9709d4a6171: Writing region info on filesystem at 1676160200766Initializing all the Stores at 1676160200767 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200767Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200767Region opened successfully at 1676160200781 (+14 ms) 2023-02-12 00:03:20,793 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:20,810 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e4e4e99323e1ae6220f2d9709d4a6171, disabling compactions & flushes 2023-02-12 00:03:20,810 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:20,810 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:20,810 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. after waiting 0 ms 2023-02-12 00:03:20,810 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:20,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676160194427.e4e4e99323e1ae6220f2d9709d4a6171. 2023-02-12 00:03:20,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e4e4e99323e1ae6220f2d9709d4a6171: Waiting for close lock at 1676160200810Disabling compacts and flushes for region at 1676160200810Disabling writes for close at 1676160200810Writing region close event to WAL at 1676160200812 (+2 ms)Closed at 1676160200812 2023-02-12 00:03:20,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,816 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,822 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,827 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:20,829 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f1 2023-02-12 00:03:20,829 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70540f7a4e3335b30ef110a69ea53ce5 columnFamilyName f1 2023-02-12 00:03:20,830 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(310): Store=70540f7a4e3335b30ef110a69ea53ce5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,830 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70540f7a4e3335b30ef110a69ea53ce5 2023-02-12 00:03:20,832 DEBUG [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/70540f7a4e3335b30ef110a69ea53ce5/f2 2023-02-12 00:03:20,833 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70540f7a4e3335b30ef110a69ea53ce5 columnFamilyName f2 2023-02-12 00:03:20,833 INFO [StoreOpener-70540f7a4e3335b30ef110a69ea53ce5-1] regionserver.HStore(310): Store=70540f7a4e3335b30ef110a69ea53ce5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,834 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 70540f7a4e3335b30ef110a69ea53ce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72834559, jitterRate=0.08531950414180756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 70540f7a4e3335b30ef110a69ea53ce5: Writing region info on filesystem at 1676160200822Initializing all the Stores at 1676160200823 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200823Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200826 (+3 ms)Region opened successfully at 1676160200834 (+8 ms) 2023-02-12 00:03:20,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 70540f7a4e3335b30ef110a69ea53ce5, disabling compactions & flushes 2023-02-12 00:03:20,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:20,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:20,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. after waiting 0 ms 2023-02-12 00:03:20,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:20,854 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160194427.70540f7a4e3335b30ef110a69ea53ce5. 2023-02-12 00:03:20,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 70540f7a4e3335b30ef110a69ea53ce5: Waiting for close lock at 1676160200853Disabling compacts and flushes for region at 1676160200853Disabling writes for close at 1676160200853Writing region close event to WAL at 1676160200854 (+1 ms)Closed at 1676160200854 2023-02-12 00:03:20,857 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,857 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,858 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,860 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:20,861 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1 2023-02-12 00:03:20,861 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a319fc5ab773730c7fa584f461469f columnFamilyName f1 2023-02-12 00:03:20,867 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f1/testWithMapReduce=f8a319fc5ab773730c7fa584f461469f-9cc5a364172648888ce14d76865098af 2023-02-12 00:03:20,867 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(310): Store=f8a319fc5ab773730c7fa584f461469f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,867 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8a319fc5ab773730c7fa584f461469f 2023-02-12 00:03:20,868 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2 2023-02-12 00:03:20,868 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8a319fc5ab773730c7fa584f461469f columnFamilyName f2 2023-02-12 00:03:20,873 DEBUG [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/f8a319fc5ab773730c7fa584f461469f/f2/testWithMapReduce=f8a319fc5ab773730c7fa584f461469f-6385afa95246453eb5fabfa0a9a18033 2023-02-12 00:03:20,873 INFO [StoreOpener-f8a319fc5ab773730c7fa584f461469f-1] regionserver.HStore(310): Store=f8a319fc5ab773730c7fa584f461469f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,874 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8a319fc5ab773730c7fa584f461469f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65778464, jitterRate=-0.019824504852294922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8a319fc5ab773730c7fa584f461469f: Writing region info on filesystem at 1676160200858Initializing all the Stores at 1676160200859 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200859Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200859Region opened successfully at 1676160200874 (+15 ms) 2023-02-12 00:03:20,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8a319fc5ab773730c7fa584f461469f, disabling compactions & flushes 2023-02-12 00:03:20,901 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:20,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:20,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. after waiting 0 ms 2023-02-12 00:03:20,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:20,902 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676160194427.f8a319fc5ab773730c7fa584f461469f. 2023-02-12 00:03:20,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8a319fc5ab773730c7fa584f461469f: Waiting for close lock at 1676160200901Disabling compacts and flushes for region at 1676160200901Disabling writes for close at 1676160200902 (+1 ms)Writing region close event to WAL at 1676160200902Closed at 1676160200902 2023-02-12 00:03:20,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,905 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,906 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,908 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:20,909 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1 2023-02-12 00:03:20,909 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9adf18cc115e5eebdd407b3a7640ea97 columnFamilyName f1 2023-02-12 00:03:20,916 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f1/testWithMapReduce=9adf18cc115e5eebdd407b3a7640ea97-de540c4286054a978de31cfae9a85563 2023-02-12 00:03:20,916 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(310): Store=9adf18cc115e5eebdd407b3a7640ea97/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,916 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9adf18cc115e5eebdd407b3a7640ea97 2023-02-12 00:03:20,917 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2 2023-02-12 00:03:20,918 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9adf18cc115e5eebdd407b3a7640ea97 columnFamilyName f2 2023-02-12 00:03:20,922 DEBUG [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/9adf18cc115e5eebdd407b3a7640ea97/f2/testWithMapReduce=9adf18cc115e5eebdd407b3a7640ea97-66b30810d838430490896678377a03f1 2023-02-12 00:03:20,922 INFO [StoreOpener-9adf18cc115e5eebdd407b3a7640ea97-1] regionserver.HStore(310): Store=9adf18cc115e5eebdd407b3a7640ea97/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,922 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9adf18cc115e5eebdd407b3a7640ea97; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72689049, jitterRate=0.08315123617649078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9adf18cc115e5eebdd407b3a7640ea97: Writing region info on filesystem at 1676160200906Initializing all the Stores at 1676160200907 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200907Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200907Region opened successfully at 1676160200922 (+15 ms) 2023-02-12 00:03:20,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9adf18cc115e5eebdd407b3a7640ea97, disabling compactions & flushes 2023-02-12 00:03:20,968 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:20,968 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:20,968 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. after waiting 0 ms 2023-02-12 00:03:20,968 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:20,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676160194427.9adf18cc115e5eebdd407b3a7640ea97. 2023-02-12 00:03:20,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9adf18cc115e5eebdd407b3a7640ea97: Waiting for close lock at 1676160200967Disabling compacts and flushes for region at 1676160200967Disabling writes for close at 1676160200968 (+1 ms)Writing region close event to WAL at 1676160200969 (+1 ms)Closed at 1676160200969 2023-02-12 00:03:20,972 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:20,972 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:20,974 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:20,976 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:20,977 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1 2023-02-12 00:03:20,977 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d557477c9f6c230e14d9cb66e67a5dc4 columnFamilyName f1 2023-02-12 00:03:20,982 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f1/testWithMapReduce=d557477c9f6c230e14d9cb66e67a5dc4-fbc53c06dbd943419f728a7181162a20 2023-02-12 00:03:20,983 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(310): Store=d557477c9f6c230e14d9cb66e67a5dc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,983 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d557477c9f6c230e14d9cb66e67a5dc4 2023-02-12 00:03:20,984 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2 2023-02-12 00:03:20,984 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d557477c9f6c230e14d9cb66e67a5dc4 columnFamilyName f2 2023-02-12 00:03:20,988 DEBUG [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/d557477c9f6c230e14d9cb66e67a5dc4/f2/testWithMapReduce=d557477c9f6c230e14d9cb66e67a5dc4-d33454dff3b74a2d80d63f964af25d3b 2023-02-12 00:03:20,989 INFO [StoreOpener-d557477c9f6c230e14d9cb66e67a5dc4-1] regionserver.HStore(310): Store=d557477c9f6c230e14d9cb66e67a5dc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:20,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:20,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d557477c9f6c230e14d9cb66e67a5dc4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62949592, jitterRate=-0.06197798252105713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:20,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d557477c9f6c230e14d9cb66e67a5dc4: Writing region info on filesystem at 1676160200974Initializing all the Stores at 1676160200975 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200975Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160200975Region opened successfully at 1676160200989 (+14 ms) 2023-02-12 00:03:21,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d557477c9f6c230e14d9cb66e67a5dc4, disabling compactions & flushes 2023-02-12 00:03:21,016 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:21,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:21,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. after waiting 0 ms 2023-02-12 00:03:21,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:21,017 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676160194427.d557477c9f6c230e14d9cb66e67a5dc4. 2023-02-12 00:03:21,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d557477c9f6c230e14d9cb66e67a5dc4: Waiting for close lock at 1676160201016Disabling compacts and flushes for region at 1676160201016Disabling writes for close at 1676160201016Writing region close event to WAL at 1676160201017 (+1 ms)Closed at 1676160201017 2023-02-12 00:03:21,020 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:21,020 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:21,021 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:21,023 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:21,025 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1 2023-02-12 00:03:21,025 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 745573e545c8759c84e229997b4340d5 columnFamilyName f1 2023-02-12 00:03:21,030 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f1/testWithMapReduce=745573e545c8759c84e229997b4340d5-ffd531d314b9432483961db69dbf9232 2023-02-12 00:03:21,030 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(310): Store=745573e545c8759c84e229997b4340d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:21,030 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 745573e545c8759c84e229997b4340d5 2023-02-12 00:03:21,031 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2 2023-02-12 00:03:21,032 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 745573e545c8759c84e229997b4340d5 columnFamilyName f2 2023-02-12 00:03:21,036 DEBUG [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(539): loaded hdfs://localhost:38083/user/jenkins/test-data/1ccc609a-67f6-8357-d18a-4982fd50cfd0/testWithMapReduceAndOfflineHBaseMultiRegion/e5342667-9962-4939-8d1a-c05cb2958619/data/default/testWithMapReduce/745573e545c8759c84e229997b4340d5/f2/testWithMapReduce=745573e545c8759c84e229997b4340d5-68147d3c69094e35a2d7e5794b5e3895 2023-02-12 00:03:21,036 INFO [StoreOpener-745573e545c8759c84e229997b4340d5-1] regionserver.HStore(310): Store=745573e545c8759c84e229997b4340d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:21,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:21,037 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 745573e545c8759c84e229997b4340d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69281461, jitterRate=0.032374218106269836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:21,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 745573e545c8759c84e229997b4340d5: Writing region info on filesystem at 1676160201021Initializing all the Stores at 1676160201022 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160201022Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160201022Region opened successfully at 1676160201038 (+16 ms) 2023-02-12 00:03:21,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 745573e545c8759c84e229997b4340d5, disabling compactions & flushes 2023-02-12 00:03:21,067 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:21,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:21,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. after waiting 0 ms 2023-02-12 00:03:21,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:21,068 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676160194427.745573e545c8759c84e229997b4340d5. 2023-02-12 00:03:21,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 745573e545c8759c84e229997b4340d5: Waiting for close lock at 1676160201067Disabling compacts and flushes for region at 1676160201067Disabling writes for close at 1676160201067Writing region close event to WAL at 1676160201068 (+1 ms)Closed at 1676160201068 2023-02-12 00:03:21,558 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:21,558 WARN [Listener at localhost/42847] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:21,561 INFO [Listener at localhost/42847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:21,663 WARN [BP-1792578548-172.31.2.10-1676160192107 heartbeating to localhost/127.0.0.1:38083] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:21,663 WARN [BP-1792578548-172.31.2.10-1676160192107 heartbeating to localhost/127.0.0.1:38083] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1792578548-172.31.2.10-1676160192107 (Datanode Uuid c54198ce-18d8-48d9-a878-b51b1d4f1fab) service to localhost/127.0.0.1:38083 2023-02-12 00:03:21,664 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/dfs/data/data3/current/BP-1792578548-172.31.2.10-1676160192107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:21,664 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/dfs/data/data4/current/BP-1792578548-172.31.2.10-1676160192107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:21,666 WARN [Listener at localhost/42847] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:21,672 INFO [Listener at localhost/42847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:21,776 WARN [BP-1792578548-172.31.2.10-1676160192107 heartbeating to localhost/127.0.0.1:38083] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:21,776 WARN [BP-1792578548-172.31.2.10-1676160192107 heartbeating to localhost/127.0.0.1:38083] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1792578548-172.31.2.10-1676160192107 (Datanode Uuid 061b379f-09c7-4e59-b2f5-fa77d89ab6d2) service to localhost/127.0.0.1:38083 2023-02-12 00:03:21,777 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/dfs/data/data1/current/BP-1792578548-172.31.2.10-1676160192107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:21,778 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/cluster_370aced7-d6e7-779c-64ae-fff152cb1646/dfs/data/data2/current/BP-1792578548-172.31.2.10-1676160192107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:21,788 INFO [Listener at localhost/42847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:21,907 INFO [Listener at localhost/42847] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:21,956 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:21,970 INFO [Listener at localhost/42847] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 103) Potentially hanging thread: (jenkins-hbase9.apache.org,40739,1676160192924)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:38083 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:38083 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42847 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:38083 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:38083 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:38083 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38083 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:38083 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=529 (was 530), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 194) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9478 (was 9832) 2023-02-12 00:03:21,981 INFO [Listener at localhost/42847] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=529, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=167, AvailableMemoryMB=9478 2023-02-12 00:03:21,997 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.log.dir so I do NOT create it in target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7 2023-02-12 00:03:21,997 WARN [Listener at localhost/42847] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:21,997 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.tmp.dir so I do NOT create it in target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7 2023-02-12 00:03:21,997 WARN [Listener at localhost/42847] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a488621-326e-9394-0708-06868571e0d1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:21,997 DEBUG [Listener at localhost/42847] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57, deleteOnExit=true 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/test.cache.data in system properties and HBase conf 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:21,998 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:21,999 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:21,999 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:21,999 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:21,999 DEBUG [Listener at localhost/42847] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:21,999 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:22,000 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:22,001 INFO [Listener at localhost/42847] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:22,006 WARN [Listener at localhost/42847] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:22,006 WARN [Listener at localhost/42847] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:22,055 WARN [Listener at localhost/42847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:22,057 INFO [Listener at localhost/42847] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:22,064 INFO [Listener at localhost/42847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/java.io.tmpdir/Jetty_localhost_38079_hdfs____.c776q1/webapp 2023-02-12 00:03:22,155 INFO [Listener at localhost/42847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38079 2023-02-12 00:03:22,159 WARN [Listener at localhost/42847] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:22,160 WARN [Listener at localhost/42847] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:22,197 WARN [Listener at localhost/44687] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:22,213 WARN [Listener at localhost/44687] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:22,215 WARN [Listener at localhost/44687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:22,216 INFO [Listener at localhost/44687] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:22,222 INFO [Listener at localhost/44687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/java.io.tmpdir/Jetty_localhost_44009_datanode____6q54ps/webapp 2023-02-12 00:03:22,316 INFO [Listener at localhost/44687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44009 2023-02-12 00:03:22,324 WARN [Listener at localhost/35539] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:22,341 WARN [Listener at localhost/35539] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:22,343 WARN [Listener at localhost/35539] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:22,344 INFO [Listener at localhost/35539] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:22,350 INFO [Listener at localhost/35539] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/java.io.tmpdir/Jetty_localhost_41123_datanode____.1nf6kk/webapp 2023-02-12 00:03:22,430 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6780c0be5d4114bf: Processing first storage report for DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8 from datanode ae772ad7-040c-44ac-ad9c-1743a1115d9d 2023-02-12 00:03:22,431 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6780c0be5d4114bf: from storage DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8 node DatanodeRegistration(127.0.0.1:37509, datanodeUuid=ae772ad7-040c-44ac-ad9c-1743a1115d9d, infoPort=33421, infoSecurePort=0, ipcPort=35539, storageInfo=lv=-57;cid=testClusterID;nsid=1837470075;c=1676160202009), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:22,431 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6780c0be5d4114bf: Processing first storage report for DS-1bf4338f-32c5-4959-8ec9-63ade736d991 from datanode ae772ad7-040c-44ac-ad9c-1743a1115d9d 2023-02-12 00:03:22,431 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6780c0be5d4114bf: from storage DS-1bf4338f-32c5-4959-8ec9-63ade736d991 node DatanodeRegistration(127.0.0.1:37509, datanodeUuid=ae772ad7-040c-44ac-ad9c-1743a1115d9d, infoPort=33421, infoSecurePort=0, ipcPort=35539, storageInfo=lv=-57;cid=testClusterID;nsid=1837470075;c=1676160202009), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:22,445 INFO [Listener at localhost/35539] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41123 2023-02-12 00:03:22,452 WARN [Listener at localhost/45861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:22,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0ef9c518823e432: Processing first storage report for DS-6c219a0b-a1e2-4667-8424-7e3045c457d5 from datanode 68497168-1345-4c64-919b-694a2a3e6d59 2023-02-12 00:03:22,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0ef9c518823e432: from storage DS-6c219a0b-a1e2-4667-8424-7e3045c457d5 node DatanodeRegistration(127.0.0.1:39207, datanodeUuid=68497168-1345-4c64-919b-694a2a3e6d59, infoPort=38637, infoSecurePort=0, ipcPort=45861, storageInfo=lv=-57;cid=testClusterID;nsid=1837470075;c=1676160202009), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 00:03:22,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0ef9c518823e432: Processing first storage report for DS-b7786b40-12ff-461d-84be-99fb1caf6f88 from datanode 68497168-1345-4c64-919b-694a2a3e6d59 2023-02-12 00:03:22,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0ef9c518823e432: from storage DS-b7786b40-12ff-461d-84be-99fb1caf6f88 node DatanodeRegistration(127.0.0.1:39207, datanodeUuid=68497168-1345-4c64-919b-694a2a3e6d59, infoPort=38637, infoSecurePort=0, ipcPort=45861, storageInfo=lv=-57;cid=testClusterID;nsid=1837470075;c=1676160202009), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:22,566 DEBUG [Listener at localhost/45861] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7 2023-02-12 00:03:22,568 INFO [Listener at localhost/45861] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/zookeeper_0, clientPort=63201, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:22,569 INFO [Listener at localhost/45861] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63201 2023-02-12 00:03:22,569 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,570 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,581 INFO [Listener at localhost/45861] util.FSUtils(479): Created version file at hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835 with version=8 2023-02-12 00:03:22,581 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,582 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,583 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44687/user/jenkins/test-data/574f413d-2b2b-4442-b19e-d0759d1235c7/hbase-staging 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:22,585 INFO [Listener at localhost/45861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:22,587 INFO [Listener at localhost/45861] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33387 2023-02-12 00:03:22,587 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,588 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,589 INFO [Listener at localhost/45861] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33387 connecting to ZooKeeper ensemble=127.0.0.1:63201 2023-02-12 00:03:22,596 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:333870x0, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:22,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33387-0x10045d7d7360000 connected 2023-02-12 00:03:22,620 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:22,620 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:22,621 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:22,623 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33387 2023-02-12 00:03:22,623 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33387 2023-02-12 00:03:22,623 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33387 2023-02-12 00:03:22,624 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33387 2023-02-12 00:03:22,625 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33387 2023-02-12 00:03:22,625 INFO [Listener at localhost/45861] master.HMaster(439): hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835, hbase.cluster.distributed=false 2023-02-12 00:03:22,640 INFO [Listener at localhost/45861] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:22,640 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,641 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,641 INFO [Listener at localhost/45861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:22,641 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,641 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:22,641 INFO [Listener at localhost/45861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:22,642 INFO [Listener at localhost/45861] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45971 2023-02-12 00:03:22,643 INFO [Listener at localhost/45861] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:22,644 DEBUG [Listener at localhost/45861] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:22,644 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,645 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,646 INFO [Listener at localhost/45861] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45971 connecting to ZooKeeper ensemble=127.0.0.1:63201 2023-02-12 00:03:22,648 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:459710x0, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:22,649 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:459710x0, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:22,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45971-0x10045d7d7360001 connected 2023-02-12 00:03:22,650 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:22,651 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:22,652 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45971 2023-02-12 00:03:22,653 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45971 2023-02-12 00:03:22,653 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45971 2023-02-12 00:03:22,657 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45971 2023-02-12 00:03:22,657 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45971 2023-02-12 00:03:22,668 INFO [Listener at localhost/45861] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:22,668 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,668 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,669 INFO [Listener at localhost/45861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:22,669 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:22,669 INFO [Listener at localhost/45861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:22,669 INFO [Listener at localhost/45861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:22,672 INFO [Listener at localhost/45861] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38585 2023-02-12 00:03:22,672 INFO [Listener at localhost/45861] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:22,673 DEBUG [Listener at localhost/45861] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:22,673 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,674 INFO [Listener at localhost/45861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,675 INFO [Listener at localhost/45861] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38585 connecting to ZooKeeper ensemble=127.0.0.1:63201 2023-02-12 00:03:22,678 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:385850x0, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:22,680 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:385850x0, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:22,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38585-0x10045d7d7360002 connected 2023-02-12 00:03:22,681 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:22,682 DEBUG [Listener at localhost/45861] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:22,683 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38585 2023-02-12 00:03:22,686 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38585 2023-02-12 00:03:22,686 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38585 2023-02-12 00:03:22,687 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38585 2023-02-12 00:03:22,687 DEBUG [Listener at localhost/45861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38585 2023-02-12 00:03:22,691 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,692 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:22,692 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,695 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:22,695 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:22,695 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,695 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:22,696 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:22,697 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,33387,1676160202585 from backup master directory 2023-02-12 00:03:22,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:22,699 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,699 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:22,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,699 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:22,714 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/hbase.id with ID: 27ecfdca-da95-4169-94a0-0ed9f634fd29 2023-02-12 00:03:22,723 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:22,725 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,733 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x50460025 to 127.0.0.1:63201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:22,741 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@832a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:22,741 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:22,742 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:22,742 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:22,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store-tmp 2023-02-12 00:03:22,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:22,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:22,755 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:22,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:22,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:22,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:22,755 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:22,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160202755Disabling compacts and flushes for region at 1676160202755Disabling writes for close at 1676160202755Writing region close event to WAL at 1676160202755Closed at 1676160202755 2023-02-12 00:03:22,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/WALs/jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,758 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33387%2C1676160202585, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/WALs/jenkins-hbase9.apache.org,33387,1676160202585, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:22,775 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK] 2023-02-12 00:03:22,775 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK] 2023-02-12 00:03:22,778 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/WALs/jenkins-hbase9.apache.org,33387,1676160202585/jenkins-hbase9.apache.org%2C33387%2C1676160202585.1676160202759 2023-02-12 00:03:22,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK], DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK]] 2023-02-12 00:03:22,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:22,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:22,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,781 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,782 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:22,783 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:22,783 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:22,784 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,784 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:22,788 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:22,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66772278, jitterRate=-0.005015522241592407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:22,789 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160202779Initializing all the Stores at 1676160202779Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160202780 (+1 ms)Cleaning up temporary data from old regions at 1676160202785 (+5 ms)Cleaning up detritus from prior splits at 1676160202785Region opened successfully at 1676160202789 (+4 ms) 2023-02-12 00:03:22,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:22,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:22,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:22,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:22,791 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:22,791 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:22,791 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:22,792 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:22,793 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:22,808 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:22,808 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:22,809 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:22,809 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:22,809 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:22,812 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,813 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:22,813 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:22,814 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:22,815 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:22,815 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:22,815 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,815 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:22,815 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,33387,1676160202585, sessionid=0x10045d7d7360000, setting cluster-up flag (Was=false) 2023-02-12 00:03:22,820 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,824 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:22,825 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,828 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:22,831 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:22,832 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:22,832 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/.tmp 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:22,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,839 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160232839 2023-02-12 00:03:22,839 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:22,839 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:22,840 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:22,840 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:22,840 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:22,840 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:22,840 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,840 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:22,840 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:22,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:22,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:22,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:22,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:22,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:22,841 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160202841,5,FailOnTimeoutGroup] 2023-02-12 00:03:22,841 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160202841,5,FailOnTimeoutGroup] 2023-02-12 00:03:22,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:22,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,842 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:22,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,851 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:22,852 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:22,852 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835 2023-02-12 00:03:22,861 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:22,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:22,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/info 2023-02-12 00:03:22,863 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:22,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:22,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:22,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:22,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:22,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:22,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:22,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/table 2023-02-12 00:03:22,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:22,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:22,868 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740 2023-02-12 00:03:22,868 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740 2023-02-12 00:03:22,870 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:22,871 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:22,873 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72888879, jitterRate=0.08612893521785736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160202861Initializing all the Stores at 1676160202862 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160202862Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160202862Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160202862Cleaning up temporary data from old regions at 1676160202869 (+7 ms)Cleaning up detritus from prior splits at 1676160202870 (+1 ms)Region opened successfully at 1676160202873 (+3 ms) 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:22,873 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:22,873 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:22,873 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160202873Disabling compacts and flushes for region at 1676160202873Disabling writes for close at 1676160202873Writing region close event to WAL at 1676160202873Closed at 1676160202873 2023-02-12 00:03:22,874 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:22,874 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:22,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:22,876 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:22,877 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:22,889 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(952): ClusterId : 27ecfdca-da95-4169-94a0-0ed9f634fd29 2023-02-12 00:03:22,889 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(952): ClusterId : 27ecfdca-da95-4169-94a0-0ed9f634fd29 2023-02-12 00:03:22,889 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:22,889 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:22,892 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:22,892 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:22,892 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:22,892 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:22,894 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:22,894 DEBUG [RS:0;jenkins-hbase9:45971] zookeeper.ReadOnlyZKClient(139): Connect 0x4c4e4cb2 to 127.0.0.1:63201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:22,894 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:22,896 DEBUG [RS:1;jenkins-hbase9:38585] zookeeper.ReadOnlyZKClient(139): Connect 0x68101460 to 127.0.0.1:63201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:22,902 DEBUG [RS:1;jenkins-hbase9:38585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d7e712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:22,902 DEBUG [RS:0;jenkins-hbase9:45971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4289bb4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:22,902 DEBUG [RS:1;jenkins-hbase9:38585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62e87f10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:22,903 DEBUG [RS:0;jenkins-hbase9:45971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46b627c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:22,911 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:38585 2023-02-12 00:03:22,911 INFO [RS:1;jenkins-hbase9:38585] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:22,911 INFO [RS:1;jenkins-hbase9:38585] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:22,911 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:22,912 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,33387,1676160202585 with isa=jenkins-hbase9.apache.org/172.31.2.10:38585, startcode=1676160202668 2023-02-12 00:03:22,912 DEBUG [RS:1;jenkins-hbase9:38585] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:22,912 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45971 2023-02-12 00:03:22,912 INFO [RS:0;jenkins-hbase9:45971] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:22,912 INFO [RS:0;jenkins-hbase9:45971] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:22,912 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:22,913 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,33387,1676160202585 with isa=jenkins-hbase9.apache.org/172.31.2.10:45971, startcode=1676160202640 2023-02-12 00:03:22,913 DEBUG [RS:0;jenkins-hbase9:45971] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:22,914 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48429, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:22,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:22,916 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54417, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:22,916 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835 2023-02-12 00:03:22,916 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44687 2023-02-12 00:03:22,916 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:22,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:22,917 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835 2023-02-12 00:03:22,917 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44687 2023-02-12 00:03:22,917 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:22,919 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:22,923 DEBUG [RS:1;jenkins-hbase9:38585] zookeeper.ZKUtil(162): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:22,923 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45971,1676160202640] 2023-02-12 00:03:22,923 WARN [RS:1;jenkins-hbase9:38585] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:22,923 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38585,1676160202668] 2023-02-12 00:03:22,923 INFO [RS:1;jenkins-hbase9:38585] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:22,923 DEBUG [RS:0;jenkins-hbase9:45971] zookeeper.ZKUtil(162): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:22,923 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:22,923 WARN [RS:0;jenkins-hbase9:45971] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:22,923 INFO [RS:0;jenkins-hbase9:45971] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:22,923 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:22,931 DEBUG [RS:0;jenkins-hbase9:45971] zookeeper.ZKUtil(162): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:22,931 DEBUG [RS:1;jenkins-hbase9:38585] zookeeper.ZKUtil(162): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:22,931 DEBUG [RS:0;jenkins-hbase9:45971] zookeeper.ZKUtil(162): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:22,931 DEBUG [RS:1;jenkins-hbase9:38585] zookeeper.ZKUtil(162): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:22,932 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:22,932 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:22,932 INFO [RS:1;jenkins-hbase9:38585] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:22,932 INFO [RS:0;jenkins-hbase9:45971] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:22,935 INFO [RS:1;jenkins-hbase9:38585] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:22,935 INFO [RS:0;jenkins-hbase9:45971] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:22,939 INFO [RS:1;jenkins-hbase9:38585] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:22,939 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,939 INFO [RS:0;jenkins-hbase9:45971] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:22,939 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,939 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:22,940 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:22,940 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,940 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:22,941 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,941 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:1;jenkins-hbase9:38585] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,942 DEBUG [RS:0;jenkins-hbase9:45971] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:22,973 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,973 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,973 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,976 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,976 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,976 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,994 INFO [RS:0;jenkins-hbase9:45971] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:22,994 INFO [RS:1;jenkins-hbase9:38585] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:22,994 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45971,1676160202640-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:22,994 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38585,1676160202668-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,009 INFO [RS:1;jenkins-hbase9:38585] regionserver.Replication(203): jenkins-hbase9.apache.org,38585,1676160202668 started 2023-02-12 00:03:23,009 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,38585,1676160202668, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38585, sessionid=0x10045d7d7360002 2023-02-12 00:03:23,009 INFO [RS:0;jenkins-hbase9:45971] regionserver.Replication(203): jenkins-hbase9.apache.org,45971,1676160202640 started 2023-02-12 00:03:23,009 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:23,009 DEBUG [RS:1;jenkins-hbase9:38585] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:23,009 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38585,1676160202668' 2023-02-12 00:03:23,009 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:23,009 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45971,1676160202640, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45971, sessionid=0x10045d7d7360001 2023-02-12 00:03:23,009 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:23,009 DEBUG [RS:0;jenkins-hbase9:45971] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:23,009 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45971,1676160202640' 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38585,1676160202668' 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45971,1676160202640' 2023-02-12 00:03:23,010 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:23,010 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:23,011 DEBUG [RS:0;jenkins-hbase9:45971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:23,011 DEBUG [RS:1;jenkins-hbase9:38585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:23,011 DEBUG [RS:0;jenkins-hbase9:45971] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:23,011 DEBUG [RS:1;jenkins-hbase9:38585] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:23,011 INFO [RS:0;jenkins-hbase9:45971] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:23,011 INFO [RS:0;jenkins-hbase9:45971] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:23,011 INFO [RS:1;jenkins-hbase9:38585] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:23,011 INFO [RS:1;jenkins-hbase9:38585] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:23,027 DEBUG [jenkins-hbase9:33387] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:23,027 DEBUG [jenkins-hbase9:33387] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:23,029 DEBUG [jenkins-hbase9:33387] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:23,029 DEBUG [jenkins-hbase9:33387] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:23,029 DEBUG [jenkins-hbase9:33387] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:23,030 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38585,1676160202668, state=OPENING 2023-02-12 00:03:23,031 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:23,038 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:23,039 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:23,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38585,1676160202668}] 2023-02-12 00:03:23,192 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:23,192 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:23,194 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:23,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:23,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:23,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38585%2C1676160202668.meta, suffix=.meta, logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,38585,1676160202668, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs, maxLogs=32 2023-02-12 00:03:23,214 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK] 2023-02-12 00:03:23,215 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK] 2023-02-12 00:03:23,216 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,38585,1676160202668/jenkins-hbase9.apache.org%2C38585%2C1676160202668.meta.1676160203201.meta 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK], DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK]] 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:23,217 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:23,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:23,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:23,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/info 2023-02-12 00:03:23,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/info 2023-02-12 00:03:23,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:23,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:23,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:23,221 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:23,221 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:23,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:23,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:23,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:23,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/table 2023-02-12 00:03:23,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/table 2023-02-12 00:03:23,223 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:23,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:23,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740 2023-02-12 00:03:23,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740 2023-02-12 00:03:23,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:23,228 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:23,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75245031, jitterRate=0.1212383359670639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:23,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160203217Writing region info on filesystem at 1676160203217Initializing all the Stores at 1676160203218 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160203218Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160203218Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160203218Cleaning up temporary data from old regions at 1676160203226 (+8 ms)Cleaning up detritus from prior splits at 1676160203226Running coprocessor post-open hooks at 1676160203229 (+3 ms)Region opened successfully at 1676160203229 2023-02-12 00:03:23,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160203192 2023-02-12 00:03:23,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:23,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:23,234 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38585,1676160202668, state=OPEN 2023-02-12 00:03:23,235 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:23,235 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:23,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:23,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38585,1676160202668 in 196 msec 2023-02-12 00:03:23,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:23,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-12 00:03:23,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 405 msec 2023-02-12 00:03:23,240 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160202692, completionTime=-1 2023-02-12 00:03:23,240 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:23,240 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:23,243 DEBUG [hconnection-0x608f712b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:23,244 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:23,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:23,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160263246 2023-02-12 00:03:23,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160323246 2023-02-12 00:03:23,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33387,1676160202585-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33387,1676160202585-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33387,1676160202585-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:33387, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:23,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:23,254 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:23,256 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:23,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:23,257 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:23,258 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,259 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5 empty. 2023-02-12 00:03:23,259 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:23,273 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:23,274 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ad79177dab52aabc20e372574f0006d5, NAME => 'hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ad79177dab52aabc20e372574f0006d5, disabling compactions & flushes 2023-02-12 00:03:23,282 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. after waiting 0 ms 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,282 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ad79177dab52aabc20e372574f0006d5: Waiting for close lock at 1676160203282Disabling compacts and flushes for region at 1676160203282Disabling writes for close at 1676160203282Writing region close event to WAL at 1676160203282Closed at 1676160203282 2023-02-12 00:03:23,284 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:23,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160203285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160203285"}]},"ts":"1676160203285"} 2023-02-12 00:03:23,287 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:23,287 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:23,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160203287"}]},"ts":"1676160203287"} 2023-02-12 00:03:23,289 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:23,292 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:23,293 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:23,293 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:23,293 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:23,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ad79177dab52aabc20e372574f0006d5, ASSIGN}] 2023-02-12 00:03:23,295 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ad79177dab52aabc20e372574f0006d5, ASSIGN 2023-02-12 00:03:23,296 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ad79177dab52aabc20e372574f0006d5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45971,1676160202640; forceNewPlan=false, retain=false 2023-02-12 00:03:23,446 INFO [jenkins-hbase9:33387] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:23,447 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ad79177dab52aabc20e372574f0006d5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:23,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160203447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160203447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160203447"}]},"ts":"1676160203447"} 2023-02-12 00:03:23,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ad79177dab52aabc20e372574f0006d5, server=jenkins-hbase9.apache.org,45971,1676160202640}] 2023-02-12 00:03:23,601 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:23,602 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:23,603 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:23,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,609 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45971%2C1676160202640, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,45971,1676160202640, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs, maxLogs=32 2023-02-12 00:03:23,623 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK] 2023-02-12 00:03:23,623 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK] 2023-02-12 00:03:23,625 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,45971,1676160202640/jenkins-hbase9.apache.org%2C45971%2C1676160202640.1676160203609 2023-02-12 00:03:23,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK], DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK]] 2023-02-12 00:03:23,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad79177dab52aabc20e372574f0006d5, NAME => 'hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:23,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:23,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,627 INFO [StoreOpener-ad79177dab52aabc20e372574f0006d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,628 DEBUG [StoreOpener-ad79177dab52aabc20e372574f0006d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/info 2023-02-12 00:03:23,628 DEBUG [StoreOpener-ad79177dab52aabc20e372574f0006d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/info 2023-02-12 00:03:23,629 INFO [StoreOpener-ad79177dab52aabc20e372574f0006d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad79177dab52aabc20e372574f0006d5 columnFamilyName info 2023-02-12 00:03:23,629 INFO [StoreOpener-ad79177dab52aabc20e372574f0006d5-1] regionserver.HStore(310): Store=ad79177dab52aabc20e372574f0006d5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:23,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:23,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:23,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened ad79177dab52aabc20e372574f0006d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73009823, jitterRate=0.08793114125728607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:23,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for ad79177dab52aabc20e372574f0006d5: Running coprocessor pre-open hook at 1676160203626Writing region info on filesystem at 1676160203626Initializing all the Stores at 1676160203627 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160203627Cleaning up temporary data from old regions at 1676160203630 (+3 ms)Cleaning up detritus from prior splits at 1676160203631 (+1 ms)Running coprocessor post-open hooks at 1676160203635 (+4 ms)Region opened successfully at 1676160203635 2023-02-12 00:03:23,636 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5., pid=6, masterSystemTime=1676160203601 2023-02-12 00:03:23,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,639 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:23,639 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ad79177dab52aabc20e372574f0006d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:23,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160203639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160203639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160203639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160203639"}]},"ts":"1676160203639"} 2023-02-12 00:03:23,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:23,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ad79177dab52aabc20e372574f0006d5, server=jenkins-hbase9.apache.org,45971,1676160202640 in 192 msec 2023-02-12 00:03:23,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:23,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ad79177dab52aabc20e372574f0006d5, ASSIGN in 349 msec 2023-02-12 00:03:23,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:23,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160203645"}]},"ts":"1676160203645"} 2023-02-12 00:03:23,646 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:23,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:23,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 395 msec 2023-02-12 00:03:23,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:23,656 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:23,656 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:23,659 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:23,663 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:23,665 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:23,673 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:23,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 00:03:23,686 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:23,693 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:23,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 00:03:23,706 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:23,708 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.009sec 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33387,1676160202585-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:23,708 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33387,1676160202585-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:23,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:23,789 DEBUG [Listener at localhost/45861] zookeeper.ReadOnlyZKClient(139): Connect 0x13a9d065 to 127.0.0.1:63201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:23,796 DEBUG [Listener at localhost/45861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d53f831, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:23,797 DEBUG [hconnection-0x587705b6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:23,799 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:23,801 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:23,801 DEBUG [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:23,803 DEBUG [Listener at localhost/45861] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:23,805 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:23,805 INFO [Listener at localhost/45861] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:23,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:23,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:23,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.2.10:45780 deadline: 1676160263805, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:23,806 INFO [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 00:03:23,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:23,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:23,812 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:23,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-12 00:03:23,812 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:23,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:23,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:23,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 empty. 2023-02-12 00:03:23,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:23,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 00:03:23,824 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:23,825 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3505fa0afc9f8004b854d0d16a1d0c62, NAME => 'testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 3505fa0afc9f8004b854d0d16a1d0c62, disabling compactions & flushes 2023-02-12 00:03:23,834 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. after waiting 0 ms 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:23,834 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:23,834 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 3505fa0afc9f8004b854d0d16a1d0c62: Waiting for close lock at 1676160203834Disabling compacts and flushes for region at 1676160203834Disabling writes for close at 1676160203834Writing region close event to WAL at 1676160203834Closed at 1676160203834 2023-02-12 00:03:23,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:23,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676160203836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160203836"}]},"ts":"1676160203836"} 2023-02-12 00:03:23,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:23,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:23,838 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160203838"}]},"ts":"1676160203838"} 2023-02-12 00:03:23,839 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-12 00:03:23,842 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:23,843 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:23,843 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:23,843 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:23,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, ASSIGN}] 2023-02-12 00:03:23,844 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, ASSIGN 2023-02-12 00:03:23,845 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38585,1676160202668; forceNewPlan=false, retain=false 2023-02-12 00:03:23,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:23,995 INFO [jenkins-hbase9:33387] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:23,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3505fa0afc9f8004b854d0d16a1d0c62, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:23,997 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676160203996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160203996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160203996"}]},"ts":"1676160203996"} 2023-02-12 00:03:23,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3505fa0afc9f8004b854d0d16a1d0c62, server=jenkins-hbase9.apache.org,38585,1676160202668}] 2023-02-12 00:03:24,013 INFO [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38585%2C1676160202668, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,38585,1676160202668, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs, maxLogs=32 2023-02-12 00:03:24,027 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK] 2023-02-12 00:03:24,028 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK] 2023-02-12 00:03:24,030 INFO [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/WALs/jenkins-hbase9.apache.org,38585,1676160202668/jenkins-hbase9.apache.org%2C38585%2C1676160202668.1676160204013 2023-02-12 00:03:24,030 DEBUG [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39207,DS-6c219a0b-a1e2-4667-8424-7e3045c457d5,DISK], DatanodeInfoWithStorage[127.0.0.1:37509,DS-2ccec4fc-b198-4529-a47c-210dcf3c3ea8,DISK]] 2023-02-12 00:03:24,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:24,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3505fa0afc9f8004b854d0d16a1d0c62, NAME => 'testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,155 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,156 DEBUG [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1 2023-02-12 00:03:24,156 DEBUG [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1 2023-02-12 00:03:24,157 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3505fa0afc9f8004b854d0d16a1d0c62 columnFamilyName f1 2023-02-12 00:03:24,157 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] regionserver.HStore(310): Store=3505fa0afc9f8004b854d0d16a1d0c62/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:24,157 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,158 DEBUG [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2 2023-02-12 00:03:24,158 DEBUG [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2 2023-02-12 00:03:24,158 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3505fa0afc9f8004b854d0d16a1d0c62 columnFamilyName f2 2023-02-12 00:03:24,159 INFO [StoreOpener-3505fa0afc9f8004b854d0d16a1d0c62-1] regionserver.HStore(310): Store=3505fa0afc9f8004b854d0d16a1d0c62/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:24,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:24,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:24,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:24,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 3505fa0afc9f8004b854d0d16a1d0c62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65081635, jitterRate=-0.03020806610584259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:24,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 3505fa0afc9f8004b854d0d16a1d0c62: Running coprocessor pre-open hook at 1676160204154Writing region info on filesystem at 1676160204154Initializing all the Stores at 1676160204155 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160204155Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160204155Cleaning up temporary data from old regions at 1676160204160 (+5 ms)Cleaning up detritus from prior splits at 1676160204161 (+1 ms)Running coprocessor post-open hooks at 1676160204164 (+3 ms)Region opened successfully at 1676160204164 2023-02-12 00:03:24,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62., pid=12, masterSystemTime=1676160204150 2023-02-12 00:03:24,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3505fa0afc9f8004b854d0d16a1d0c62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,168 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676160204167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160204167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160204167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160204167"}]},"ts":"1676160204167"} 2023-02-12 00:03:24,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 00:03:24,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3505fa0afc9f8004b854d0d16a1d0c62, server=jenkins-hbase9.apache.org,38585,1676160202668 in 171 msec 2023-02-12 00:03:24,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 00:03:24,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, ASSIGN in 327 msec 2023-02-12 00:03:24,173 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:24,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160204173"}]},"ts":"1676160204173"} 2023-02-12 00:03:24,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-12 00:03:24,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:24,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 367 msec 2023-02-12 00:03:24,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:24,418 INFO [Listener at localhost/45861] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-12 00:03:24,419 DEBUG [Listener at localhost/45861] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-12 00:03:24,419 INFO [Listener at localhost/45861] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:24,421 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-12 00:03:24,421 INFO [Listener at localhost/45861] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:24,421 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-12 00:03:24,421 INFO [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:24,478 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38585] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,605 INFO [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:24,605 INFO [Listener at localhost/45861] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:24,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 00:03:24,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160204607 (current time:1676160204607). 2023-02-12 00:03:24,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:24,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] zookeeper.ReadOnlyZKClient(139): Connect 0x4cdea4b1 to 127.0.0.1:63201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:24,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ae0f344, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:24,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:24,619 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:24,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cdea4b1 to 127.0.0.1:63201 2023-02-12 00:03:24,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:24,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:24,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 00:03:24,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 00:03:24,624 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 00:03:24,624 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676160804624 2023-02-12 00:03:24,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 00:03:24,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:24,625 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:24,625 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:24,626 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 00:03:24,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 00:03:24,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-12 00:03:24,627 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 00:03:24,628 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676160804628 2023-02-12 00:03:24,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 00:03:24,638 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 00:03:24,638 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:24,638 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 00:03:24,639 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 00:03:24,639 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,639 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,640 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:24,640 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:24,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:24,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:24,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:24,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 00:03:24,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 00:03:24,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 00:03:24,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 00:03:24,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 00:03:24,642 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,642 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 00:03:24,642 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:24,642 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 00:03:24,643 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 00:03:24,643 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 00:03:24,643 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:24,643 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45971,1676160202640' joining acquired barrier for procedure (foo) in zk 2023-02-12 00:03:24,644 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 00:03:24,644 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 00:03:24,643 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,644 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:24,644 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38585,1676160202668' joining acquired barrier for procedure (foo) in zk 2023-02-12 00:03:24,645 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,647 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,647 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,647 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:24,647 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:24,648 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,648 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38585,1676160202668' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 00:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7429b1c5[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:24,649 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 00:03:24,649 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,651 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,45971,1676160202640' in zk 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 00:03:24,651 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:24,651 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,651 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. started... 2023-02-12 00:03:24,652 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3505fa0afc9f8004b854d0d16a1d0c62 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 00:03:24,653 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 00:03:24,653 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:24,653 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 00:03:24,674 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f1/74dfeb0db6154976931ddd3b7d67bdad 2023-02-12 00:03:24,699 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f2/ca633f23f71d44cc9897a6ef03b09cd8 2023-02-12 00:03:24,704 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f1/74dfeb0db6154976931ddd3b7d67bdad as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad 2023-02-12 00:03:24,708 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:24,709 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f2/ca633f23f71d44cc9897a6ef03b09cd8 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8 2023-02-12 00:03:24,714 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:24,714 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3505fa0afc9f8004b854d0d16a1d0c62 in 62ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:24,714 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3505fa0afc9f8004b854d0d16a1d0c62: 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.' region-info for snapshot=foo 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad] hfiles 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad for snapshot=foo 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8] hfiles 2023-02-12 00:03:24,715 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8 for snapshot=foo 2023-02-12 00:03:24,726 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. completed. 2023-02-12 00:03:24,726 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:24,726 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 00:03:24,726 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 00:03:24,726 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,726 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 00:03:24,726 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:24,726 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,38585,1676160202668' in zk 2023-02-12 00:03:24,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 00:03:24,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:24,727 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:24,728 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 00:03:24,728 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:24,728 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,728 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 00:03:24,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:24,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:24,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,38585,1676160202668': 2023-02-12 00:03:24,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38585,1676160202668' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 00:03:24,732 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 00:03:24,732 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:24,732 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:24,732 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 00:03:24,732 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:24,735 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:24,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:24,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:24,735 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:24,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,735 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:24,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:24,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:24,736 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,738 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:24,738 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:24,744 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 00:03:24,744 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:24,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:24,745 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 00:03:24,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:24,744 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:24,746 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:24,746 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:24,746 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:24,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:24,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:24,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:24,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/.tmp/foo to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/foo 2023-02-12 00:03:24,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-12 00:03:24,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:24,781 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:24,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676160204624Consolidate snapshot: foo at 1676160204745 (+121 ms)Loading Region manifests for foo at 1676160204746 (+1 ms)Writing data manifest for foo at 1676160204750 (+4 ms)Verifying snapshot: foo at 1676160204759 (+9 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676160204781 (+22 ms) 2023-02-12 00:03:24,783 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 00:03:24,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 158 msec 2023-02-12 00:03:24,928 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:24,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 00:03:24,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:24,929 INFO [Listener at localhost/45861] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:24,933 INFO [Listener at localhost/45861] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:24,938 INFO [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:24,968 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38585] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,056 INFO [Listener at localhost/45861] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:25,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,064 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-12 00:03:25,064 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:25,065 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-12 00:03:25,065 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-12 00:03:25,066 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,066 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,067 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,067 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:25,067 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:25,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:25,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,068 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,075 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 00:03:25,075 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:25,075 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 00:03:25,076 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:25,076 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 00:03:25,076 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 00:03:25,076 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 00:03:25,076 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45971,1676160202640' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 00:03:25,078 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,078 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,078 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:25,079 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 00:03:25,079 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:25,079 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,079 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. started... 2023-02-12 00:03:25,079 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3505fa0afc9f8004b854d0d16a1d0c62 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 00:03:25,099 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f1/2f317d1c7a774433b31440f35ce5b24b 2023-02-12 00:03:25,121 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f2/6eb0650e4b6c400b9303b7eddcf722a4 2023-02-12 00:03:25,126 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f1/2f317d1c7a774433b31440f35ce5b24b as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/2f317d1c7a774433b31440f35ce5b24b 2023-02-12 00:03:25,129 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/2f317d1c7a774433b31440f35ce5b24b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:25,130 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/.tmp/f2/6eb0650e4b6c400b9303b7eddcf722a4 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/6eb0650e4b6c400b9303b7eddcf722a4 2023-02-12 00:03:25,134 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/6eb0650e4b6c400b9303b7eddcf722a4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:25,135 INFO [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3505fa0afc9f8004b854d0d16a1d0c62 in 56ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:25,136 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3505fa0afc9f8004b854d0d16a1d0c62: 2023-02-12 00:03:25,136 DEBUG [rs(jenkins-hbase9.apache.org,38585,1676160202668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,136 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 00:03:25,136 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 00:03:25,136 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,137 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 00:03:25,137 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38585,1676160202668' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 00:03:25,139 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,139 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:25,140 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,140 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38585,1676160202668' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-12 00:03:25,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70162b98[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:25,142 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-12 00:03:25,142 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 00:03:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,143 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,143 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,38585,1676160202668' in zk 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 00:03:25,143 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,45971,1676160202640' in zk 2023-02-12 00:03:25,145 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 00:03:25,145 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:25,145 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 00:03:25,145 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,146 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,145 DEBUG [member: 'jenkins-hbase9.apache.org,38585,1676160202668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 00:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:25,146 DEBUG [member: 'jenkins-hbase9.apache.org,45971,1676160202640' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 00:03:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase9.apache.org,38585,1676160202668': 2023-02-12 00:03:25,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38585,1676160202668' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-12 00:03:25,150 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-12 00:03:25,150 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:25,150 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:25,150 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,150 INFO [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:25,151 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:25,151 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:25,151 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:25,152 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:25,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:25,152 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,154 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,154 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-12 00:03:25,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:25,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,159 DEBUG [(jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:25,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:25,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:25,159 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:25,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:25,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:25,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:25,160 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,260 DEBUG [Listener at localhost/45861] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:25,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:25,266 INFO [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676160204607 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:25,266 DEBUG [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44687/user/jenkins/test-data/574f413d-2b2b-4442-b19e-d0759d1235c7/foo/c078c5f0-315b-4d4a-a102-5efb2d7838e7/data/default/testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,267 INFO [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(239): region to add: 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:25,267 INFO [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(585): clone region=3505fa0afc9f8004b854d0d16a1d0c62 as 3505fa0afc9f8004b854d0d16a1d0c62 in snapshot foo 2023-02-12 00:03:25,268 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3505fa0afc9f8004b854d0d16a1d0c62, NAME => 'testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/574f413d-2b2b-4442-b19e-d0759d1235c7/foo/c078c5f0-315b-4d4a-a102-5efb2d7838e7 2023-02-12 00:03:25,277 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:25,277 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74dfeb0db6154976931ddd3b7d67bdad from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,279 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ca633f23f71d44cc9897a6ef03b09cd8 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3505fa0afc9f8004b854d0d16a1d0c62, disabling compactions & flushes 2023-02-12 00:03:25,281 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. after waiting 0 ms 2023-02-12 00:03:25,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,281 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3505fa0afc9f8004b854d0d16a1d0c62: Waiting for close lock at 1676160205281Disabling compacts and flushes for region at 1676160205281Disabling writes for close at 1676160205281Writing region close event to WAL at 1676160205281Closed at 1676160205281 2023-02-12 00:03:25,282 INFO [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676160204607 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:25,282 DEBUG [Listener at localhost/45861] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44687/user/jenkins/test-data/574f413d-2b2b-4442-b19e-d0759d1235c7/foo/c078c5f0-315b-4d4a-a102-5efb2d7838e7 2023-02-12 00:03:25,282 DEBUG [Listener at localhost/45861] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44687/user/jenkins/test-data/574f413d-2b2b-4442-b19e-d0759d1235c7/foo/c078c5f0-315b-4d4a-a102-5efb2d7838e7 2023-02-12 00:03:25,282 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:25,283 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:25,283 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-12 00:03:25,284 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |----------3505fa0afc9f8004b854d0d16a1d0c62/ 2023-02-12 00:03:25,284 DEBUG [Listener at localhost/45861] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:25,284 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:25,285 DEBUG [Listener at localhost/45861] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=3505fa0afc9f8004b854d0d16a1d0c62-74dfeb0db6154976931ddd3b7d67bdad 2023-02-12 00:03:25,285 DEBUG [Listener at localhost/45861] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:25,285 DEBUG [Listener at localhost/45861] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=3505fa0afc9f8004b854d0d16a1d0c62-ca633f23f71d44cc9897a6ef03b09cd8 2023-02-12 00:03:25,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-12 00:03:25,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 00:03:25,290 INFO [Listener at localhost/45861] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:25,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160205293"}]},"ts":"1676160205293"} 2023-02-12 00:03:25,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-12 00:03:25,296 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-12 00:03:25,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, UNASSIGN}] 2023-02-12 00:03:25,299 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, UNASSIGN 2023-02-12 00:03:25,299 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3505fa0afc9f8004b854d0d16a1d0c62, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,300 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676160205299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160205299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160205299"}]},"ts":"1676160205299"} 2023-02-12 00:03:25,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3505fa0afc9f8004b854d0d16a1d0c62, server=jenkins-hbase9.apache.org,38585,1676160202668}] 2023-02-12 00:03:25,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:25,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:25,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 3505fa0afc9f8004b854d0d16a1d0c62, disabling compactions & flushes 2023-02-12 00:03:25,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. after waiting 0 ms 2023-02-12 00:03:25,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:25,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62. 2023-02-12 00:03:25,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 3505fa0afc9f8004b854d0d16a1d0c62: Waiting for close lock at 1676160205453Running coprocessor pre-close hooks at 1676160205453Disabling compacts and flushes for region at 1676160205453Disabling writes for close at 1676160205453Writing region close event to WAL at 1676160205454 (+1 ms)Running coprocessor post-close hooks at 1676160205458 (+4 ms)Closed at 1676160205458 2023-02-12 00:03:25,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:25,459 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3505fa0afc9f8004b854d0d16a1d0c62, regionState=CLOSED 2023-02-12 00:03:25,460 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676160205459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160205459"}]},"ts":"1676160205459"} 2023-02-12 00:03:25,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 00:03:25,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3505fa0afc9f8004b854d0d16a1d0c62, server=jenkins-hbase9.apache.org,38585,1676160202668 in 160 msec 2023-02-12 00:03:25,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 00:03:25,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=3505fa0afc9f8004b854d0d16a1d0c62, UNASSIGN in 165 msec 2023-02-12 00:03:25,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160205464"}]},"ts":"1676160205464"} 2023-02-12 00:03:25,465 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-12 00:03:25,467 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-12 00:03:25,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-12 00:03:25,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:25,597 INFO [Listener at localhost/45861] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-12 00:03:25,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,601 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,601 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:25,605 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:25,607 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1, FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2, FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/recovered.edits] 2023-02-12 00:03:25,610 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/2f317d1c7a774433b31440f35ce5b24b to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/archive/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/2f317d1c7a774433b31440f35ce5b24b 2023-02-12 00:03:25,611 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/archive/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f1/74dfeb0db6154976931ddd3b7d67bdad 2023-02-12 00:03:25,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/6eb0650e4b6c400b9303b7eddcf722a4 to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/archive/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/6eb0650e4b6c400b9303b7eddcf722a4 2023-02-12 00:03:25,615 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8 to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/archive/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/f2/ca633f23f71d44cc9897a6ef03b09cd8 2023-02-12 00:03:25,618 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/recovered.edits/12.seqid to hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/archive/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62/recovered.edits/12.seqid 2023-02-12 00:03:25,618 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/.tmp/data/default/testInitTableSnapshotMapperJobConfig/3505fa0afc9f8004b854d0d16a1d0c62 2023-02-12 00:03:25,618 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 00:03:25,620 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,622 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-12 00:03:25,624 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-12 00:03:25,625 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,625 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-12 00:03:25,625 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160205625"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:25,626 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 00:03:25,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3505fa0afc9f8004b854d0d16a1d0c62, NAME => 'testInitTableSnapshotMapperJobConfig,,1676160203808.3505fa0afc9f8004b854d0d16a1d0c62.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 00:03:25,626 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-12 00:03:25,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160205626"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:25,630 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-12 00:03:25,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 00:03:25,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 33 msec 2023-02-12 00:03:25,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33387] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:25,704 INFO [Listener at localhost/45861] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-12 00:03:25,704 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:25,704 INFO [Listener at localhost/45861] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:25,704 DEBUG [Listener at localhost/45861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13a9d065 to 127.0.0.1:63201 2023-02-12 00:03:25,705 DEBUG [Listener at localhost/45861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,705 DEBUG [Listener at localhost/45861] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:25,705 DEBUG [Listener at localhost/45861] util.JVMClusterUtil(257): Found active master hash=1379415944, stopped=false 2023-02-12 00:03:25,705 INFO [Listener at localhost/45861] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:25,708 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:25,708 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:25,708 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:25,708 INFO [Listener at localhost/45861] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:25,708 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:25,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:25,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:25,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:25,710 DEBUG [Listener at localhost/45861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50460025 to 127.0.0.1:63201 2023-02-12 00:03:25,710 DEBUG [Listener at localhost/45861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,710 INFO [Listener at localhost/45861] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45971,1676160202640' ***** 2023-02-12 00:03:25,710 INFO [Listener at localhost/45861] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:25,710 INFO [Listener at localhost/45861] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,38585,1676160202668' ***** 2023-02-12 00:03:25,710 INFO [Listener at localhost/45861] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:25,710 INFO [RS:0;jenkins-hbase9:45971] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:25,710 INFO [RS:1;jenkins-hbase9:38585] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:25,710 INFO [RS:0;jenkins-hbase9:45971] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:25,711 INFO [RS:1;jenkins-hbase9:38585] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:25,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:25,711 INFO [RS:1;jenkins-hbase9:38585] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:25,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:25,711 INFO [RS:0;jenkins-hbase9:45971] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:25,711 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,712 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(3304): Received CLOSE for ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:25,712 DEBUG [RS:1;jenkins-hbase9:38585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68101460 to 127.0.0.1:63201 2023-02-12 00:03:25,712 DEBUG [RS:1;jenkins-hbase9:38585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,712 INFO [RS:1;jenkins-hbase9:38585] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:25,712 INFO [RS:1;jenkins-hbase9:38585] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:25,712 INFO [RS:1;jenkins-hbase9:38585] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:25,713 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:25,713 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,713 DEBUG [RS:0;jenkins-hbase9:45971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c4e4cb2 to 127.0.0.1:63201 2023-02-12 00:03:25,713 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:25,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing ad79177dab52aabc20e372574f0006d5, disabling compactions & flushes 2023-02-12 00:03:25,714 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 00:03:25,713 DEBUG [RS:0;jenkins-hbase9:45971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,714 DEBUG [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 00:03:25,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:25,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:25,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:25,714 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:25,715 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1479): Online Regions={ad79177dab52aabc20e372574f0006d5=hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5.} 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:25,715 DEBUG [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1505): Waiting on ad79177dab52aabc20e372574f0006d5 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. after waiting 0 ms 2023-02-12 00:03:25,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:25,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-12 00:03:25,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing ad79177dab52aabc20e372574f0006d5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:25,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/.tmp/info/81cc4883e86c40c4a8355927ffd0b3e6 2023-02-12 00:03:25,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/info/7cdc8d9fc9e54159bb159912d17d3c5c 2023-02-12 00:03:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/.tmp/info/81cc4883e86c40c4a8355927ffd0b3e6 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/info/81cc4883e86c40c4a8355927ffd0b3e6 2023-02-12 00:03:25,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cdc8d9fc9e54159bb159912d17d3c5c 2023-02-12 00:03:25,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/info/81cc4883e86c40c4a8355927ffd0b3e6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:25,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ad79177dab52aabc20e372574f0006d5 in 31ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:25,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/rep_barrier/3bab11998a6943ce834c144333d29e64 2023-02-12 00:03:25,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/namespace/ad79177dab52aabc20e372574f0006d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:25,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:25,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for ad79177dab52aabc20e372574f0006d5: Waiting for close lock at 1676160205713Running coprocessor pre-close hooks at 1676160205713Disabling compacts and flushes for region at 1676160205713Disabling writes for close at 1676160205715 (+2 ms)Obtaining lock to block concurrent updates at 1676160205715Preparing flush snapshotting stores in ad79177dab52aabc20e372574f0006d5 at 1676160205715Finished memstore snapshotting hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160205715Flushing stores of hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. at 1676160205716 (+1 ms)Flushing ad79177dab52aabc20e372574f0006d5/info: creating writer at 1676160205716Flushing ad79177dab52aabc20e372574f0006d5/info: appending metadata at 1676160205720 (+4 ms)Flushing ad79177dab52aabc20e372574f0006d5/info: closing flushed file at 1676160205720Flushing ad79177dab52aabc20e372574f0006d5/info: reopening flushed file at 1676160205742 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ad79177dab52aabc20e372574f0006d5 in 31ms, sequenceid=6, compaction requested=false at 1676160205746 (+4 ms)Writing region close event to WAL at 1676160205751 (+5 ms)Running coprocessor post-close hooks at 1676160205755 (+4 ms)Closed at 1676160205755 2023-02-12 00:03:25,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160203253.ad79177dab52aabc20e372574f0006d5. 2023-02-12 00:03:25,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bab11998a6943ce834c144333d29e64 2023-02-12 00:03:25,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/table/c4b71f3afdc74e17ade02e7ed3cbb2d7 2023-02-12 00:03:25,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4b71f3afdc74e17ade02e7ed3cbb2d7 2023-02-12 00:03:25,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/info/7cdc8d9fc9e54159bb159912d17d3c5c as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/info/7cdc8d9fc9e54159bb159912d17d3c5c 2023-02-12 00:03:25,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cdc8d9fc9e54159bb159912d17d3c5c 2023-02-12 00:03:25,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/info/7cdc8d9fc9e54159bb159912d17d3c5c, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 00:03:25,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/rep_barrier/3bab11998a6943ce834c144333d29e64 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/rep_barrier/3bab11998a6943ce834c144333d29e64 2023-02-12 00:03:25,778 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:25,779 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:25,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bab11998a6943ce834c144333d29e64 2023-02-12 00:03:25,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/rep_barrier/3bab11998a6943ce834c144333d29e64, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 00:03:25,784 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/.tmp/table/c4b71f3afdc74e17ade02e7ed3cbb2d7 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/table/c4b71f3afdc74e17ade02e7ed3cbb2d7 2023-02-12 00:03:25,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4b71f3afdc74e17ade02e7ed3cbb2d7 2023-02-12 00:03:25,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/table/c4b71f3afdc74e17ade02e7ed3cbb2d7, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 00:03:25,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false 2023-02-12 00:03:25,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 00:03:25,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:25,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:25,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160205714Running coprocessor pre-close hooks at 1676160205714Disabling compacts and flushes for region at 1676160205714Disabling writes for close at 1676160205715 (+1 ms)Obtaining lock to block concurrent updates at 1676160205715Preparing flush snapshotting stores in 1588230740 at 1676160205715Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676160205715Flushing stores of hbase:meta,,1.1588230740 at 1676160205716 (+1 ms)Flushing 1588230740/info: creating writer at 1676160205716Flushing 1588230740/info: appending metadata at 1676160205721 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676160205721Flushing 1588230740/rep_barrier: creating writer at 1676160205742 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160205745 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160205745Flushing 1588230740/table: creating writer at 1676160205758 (+13 ms)Flushing 1588230740/table: appending metadata at 1676160205760 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676160205760Flushing 1588230740/info: reopening flushed file at 1676160205773 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160205778 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676160205785 (+7 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false at 1676160205790 (+5 ms)Writing region close event to WAL at 1676160205792 (+2 ms)Running coprocessor post-close hooks at 1676160205795 (+3 ms)Closed at 1676160205795 2023-02-12 00:03:25,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:25,915 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,38585,1676160202668; all regions closed. 2023-02-12 00:03:25,915 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45971,1676160202640; all regions closed. 2023-02-12 00:03:25,921 DEBUG [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs 2023-02-12 00:03:25,921 INFO [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38585%2C1676160202668.meta:.meta(num 1676160203201) 2023-02-12 00:03:25,921 DEBUG [RS:0;jenkins-hbase9:45971] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs 2023-02-12 00:03:25,921 INFO [RS:0;jenkins-hbase9:45971] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45971%2C1676160202640:(num 1676160203609) 2023-02-12 00:03:25,921 DEBUG [RS:0;jenkins-hbase9:45971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,921 INFO [RS:0;jenkins-hbase9:45971] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:25,922 INFO [RS:0;jenkins-hbase9:45971] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:25,922 INFO [RS:0;jenkins-hbase9:45971] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:25,922 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:25,922 INFO [RS:0;jenkins-hbase9:45971] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:25,923 INFO [RS:0;jenkins-hbase9:45971] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:25,924 INFO [RS:0;jenkins-hbase9:45971] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45971 2023-02-12 00:03:25,926 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:25,926 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,926 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b0bfbd rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:25,926 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:25,927 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@754e86ec rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:25,926 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45971,1676160202640 2023-02-12 00:03:25,928 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:25,928 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45971,1676160202640] 2023-02-12 00:03:25,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45971,1676160202640; numProcessing=1 2023-02-12 00:03:25,928 DEBUG [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/oldWALs 2023-02-12 00:03:25,929 INFO [RS:1;jenkins-hbase9:38585] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38585%2C1676160202668:(num 1676160204013) 2023-02-12 00:03:25,929 DEBUG [RS:1;jenkins-hbase9:38585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,929 INFO [RS:1;jenkins-hbase9:38585] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:25,929 INFO [RS:1;jenkins-hbase9:38585] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:25,929 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:25,929 INFO [RS:1;jenkins-hbase9:38585] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38585 2023-02-12 00:03:25,930 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45971,1676160202640 already deleted, retry=false 2023-02-12 00:03:25,930 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45971,1676160202640 expired; onlineServers=1 2023-02-12 00:03:25,931 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38585,1676160202668 2023-02-12 00:03:25,931 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:25,932 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@177f42f4 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:25,932 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38585,1676160202668] 2023-02-12 00:03:25,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38585,1676160202668; numProcessing=2 2023-02-12 00:03:25,933 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38585,1676160202668 already deleted, retry=false 2023-02-12 00:03:25,934 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,38585,1676160202668 expired; onlineServers=0 2023-02-12 00:03:25,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,33387,1676160202585' ***** 2023-02-12 00:03:25,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:25,934 DEBUG [M:0;jenkins-hbase9:33387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5607b917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:25,934 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,33387,1676160202585 2023-02-12 00:03:25,934 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,33387,1676160202585; all regions closed. 2023-02-12 00:03:25,934 DEBUG [M:0;jenkins-hbase9:33387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:25,934 DEBUG [M:0;jenkins-hbase9:33387] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:25,934 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:25,934 DEBUG [M:0;jenkins-hbase9:33387] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:25,934 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160202841] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160202841,5,FailOnTimeoutGroup] 2023-02-12 00:03:25,934 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160202841] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160202841,5,FailOnTimeoutGroup] 2023-02-12 00:03:25,935 INFO [M:0;jenkins-hbase9:33387] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:25,936 INFO [M:0;jenkins-hbase9:33387] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:25,936 INFO [M:0;jenkins-hbase9:33387] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:25,936 DEBUG [M:0;jenkins-hbase9:33387] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:25,936 INFO [M:0;jenkins-hbase9:33387] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:25,936 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:25,936 ERROR [M:0;jenkins-hbase9:33387] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:25,936 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:25,937 INFO [M:0;jenkins-hbase9:33387] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:25,937 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:25,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:25,937 DEBUG [M:0;jenkins-hbase9:33387] zookeeper.ZKUtil(398): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:25,937 WARN [M:0;jenkins-hbase9:33387] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:25,937 INFO [M:0;jenkins-hbase9:33387] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:25,938 INFO [M:0;jenkins-hbase9:33387] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:25,938 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:25,938 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:25,938 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:25,938 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:25,938 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:25,938 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.93 KB heapSize=66.91 KB 2023-02-12 00:03:25,947 INFO [M:0;jenkins-hbase9:33387] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.93 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a3f19c3476004a04a7c0c56329fd42a8 2023-02-12 00:03:25,951 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a3f19c3476004a04a7c0c56329fd42a8 as hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a3f19c3476004a04a7c0c56329fd42a8 2023-02-12 00:03:25,955 INFO [M:0;jenkins-hbase9:33387] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/4b34b7ec-0f07-f324-a6e0-42f073716835/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a3f19c3476004a04a7c0c56329fd42a8, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 00:03:25,956 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegion(2947): Finished flush of dataSize ~55.93 KB/57271, heapSize ~66.90 KB/68504, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-12 00:03:25,957 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:25,957 DEBUG [M:0;jenkins-hbase9:33387] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160205938Disabling compacts and flushes for region at 1676160205938Disabling writes for close at 1676160205938Obtaining lock to block concurrent updates at 1676160205938Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160205938Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57271, getHeapSize=68504, getOffHeapSize=0, getCellsCount=145 at 1676160205938Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160205939 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160205940 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160205942 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160205942Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160205952 (+10 ms)Finished flush of dataSize ~55.93 KB/57271, heapSize ~66.90 KB/68504, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676160205956 (+4 ms)Writing region close event to WAL at 1676160205957 (+1 ms)Closed at 1676160205957 2023-02-12 00:03:25,960 INFO [M:0;jenkins-hbase9:33387] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:25,960 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:25,960 INFO [M:0;jenkins-hbase9:33387] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33387 2023-02-12 00:03:25,964 DEBUG [M:0;jenkins-hbase9:33387] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,33387,1676160202585 already deleted, retry=false 2023-02-12 00:03:26,108 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,108 INFO [M:0;jenkins-hbase9:33387] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,33387,1676160202585; zookeeper connection closed. 2023-02-12 00:03:26,108 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6841195e rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,109 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): master:33387-0x10045d7d7360000, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,109 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78f4c4af rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,208 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,208 INFO [RS:1;jenkins-hbase9:38585] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,38585,1676160202668; zookeeper connection closed. 2023-02-12 00:03:26,208 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@adb3093 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,208 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:38585-0x10045d7d7360002, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,208 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72ad9d2a rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,208 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@ab9d28f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@ab9d28f 2023-02-12 00:03:26,308 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,308 INFO [RS:0;jenkins-hbase9:45971] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45971,1676160202640; zookeeper connection closed. 2023-02-12 00:03:26,308 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d2bff6f rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,309 DEBUG [Listener at localhost/45861-EventThread] zookeeper.ZKWatcher(600): regionserver:45971-0x10045d7d7360001, quorum=127.0.0.1:63201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:26,309 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@357e0f92] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@357e0f92 2023-02-12 00:03:26,309 ERROR [Listener at localhost/45861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24dad177 rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:26,309 INFO [Listener at localhost/45861] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:26,309 WARN [Listener at localhost/45861] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:26,313 INFO [Listener at localhost/45861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:26,420 WARN [BP-739992530-172.31.2.10-1676160202009 heartbeating to localhost/127.0.0.1:44687] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:26,420 WARN [BP-739992530-172.31.2.10-1676160202009 heartbeating to localhost/127.0.0.1:44687] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-739992530-172.31.2.10-1676160202009 (Datanode Uuid 68497168-1345-4c64-919b-694a2a3e6d59) service to localhost/127.0.0.1:44687 2023-02-12 00:03:26,421 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/dfs/data/data3/current/BP-739992530-172.31.2.10-1676160202009] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:26,421 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/dfs/data/data4/current/BP-739992530-172.31.2.10-1676160202009] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:26,422 WARN [Listener at localhost/45861] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:26,427 INFO [Listener at localhost/45861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:26,434 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:26,531 WARN [BP-739992530-172.31.2.10-1676160202009 heartbeating to localhost/127.0.0.1:44687] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:26,531 WARN [BP-739992530-172.31.2.10-1676160202009 heartbeating to localhost/127.0.0.1:44687] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-739992530-172.31.2.10-1676160202009 (Datanode Uuid ae772ad7-040c-44ac-ad9c-1743a1115d9d) service to localhost/127.0.0.1:44687 2023-02-12 00:03:26,532 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/dfs/data/data1/current/BP-739992530-172.31.2.10-1676160202009] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:26,532 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/cluster_f7b93aea-7fff-887e-c907-8d6e431f8d57/dfs/data/data2/current/BP-739992530-172.31.2.10-1676160202009] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:26,542 INFO [Listener at localhost/45861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:26,656 INFO [Listener at localhost/45861] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:26,674 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:26,686 INFO [Listener at localhost/45861] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 154) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:44687 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase9.apache.org,33387,1676160202585)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45861 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:44687 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:44687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:44687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 529) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 209), ProcessCount=167 (was 167), AvailableMemoryMB=9445 (was 9478) 2023-02-12 00:03:26,695 INFO [Listener at localhost/45861] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=167, AvailableMemoryMB=9445 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.log.dir so I do NOT create it in target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2 2023-02-12 00:03:26,705 WARN [Listener at localhost/45861] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.tmp.dir so I do NOT create it in target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2 2023-02-12 00:03:26,705 WARN [Listener at localhost/45861] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6a051d48-5d12-49c6-558a-6e39631b37d7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:26,705 DEBUG [Listener at localhost/45861] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696, deleteOnExit=true 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:26,705 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/test.cache.data in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:26,706 DEBUG [Listener at localhost/45861] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:26,706 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:26,707 INFO [Listener at localhost/45861] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:26,711 WARN [Listener at localhost/45861] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:26,712 WARN [Listener at localhost/45861] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:26,756 WARN [Listener at localhost/45861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:26,759 INFO [Listener at localhost/45861] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:26,765 INFO [Listener at localhost/45861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/java.io.tmpdir/Jetty_localhost_45757_hdfs____.n5057i/webapp 2023-02-12 00:03:26,858 INFO [Listener at localhost/45861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45757 2023-02-12 00:03:26,862 WARN [Listener at localhost/45861] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:26,862 WARN [Listener at localhost/45861] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:26,904 WARN [Listener at localhost/46745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:26,917 WARN [Listener at localhost/46745] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:26,919 WARN [Listener at localhost/46745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:26,920 INFO [Listener at localhost/46745] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:26,929 INFO [Listener at localhost/46745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/java.io.tmpdir/Jetty_localhost_35861_datanode____ly6th4/webapp 2023-02-12 00:03:27,025 INFO [Listener at localhost/46745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35861 2023-02-12 00:03:27,032 WARN [Listener at localhost/37275] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:27,048 WARN [Listener at localhost/37275] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:27,050 WARN [Listener at localhost/37275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:27,051 INFO [Listener at localhost/37275] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:27,056 INFO [Listener at localhost/37275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/java.io.tmpdir/Jetty_localhost_39345_datanode____2w1os5/webapp 2023-02-12 00:03:27,125 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24cad509074181d7: Processing first storage report for DS-c2145750-22ca-486b-9215-6c91e287e274 from datanode e8697f9b-3415-4cd0-b2e0-ee4771a66aeb 2023-02-12 00:03:27,125 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24cad509074181d7: from storage DS-c2145750-22ca-486b-9215-6c91e287e274 node DatanodeRegistration(127.0.0.1:45085, datanodeUuid=e8697f9b-3415-4cd0-b2e0-ee4771a66aeb, infoPort=46521, infoSecurePort=0, ipcPort=37275, storageInfo=lv=-57;cid=testClusterID;nsid=1376321605;c=1676160206714), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:27,125 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24cad509074181d7: Processing first storage report for DS-22925219-fd88-47b7-bcae-fb8fd8c06b87 from datanode e8697f9b-3415-4cd0-b2e0-ee4771a66aeb 2023-02-12 00:03:27,126 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24cad509074181d7: from storage DS-22925219-fd88-47b7-bcae-fb8fd8c06b87 node DatanodeRegistration(127.0.0.1:45085, datanodeUuid=e8697f9b-3415-4cd0-b2e0-ee4771a66aeb, infoPort=46521, infoSecurePort=0, ipcPort=37275, storageInfo=lv=-57;cid=testClusterID;nsid=1376321605;c=1676160206714), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:27,154 INFO [Listener at localhost/37275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39345 2023-02-12 00:03:27,163 WARN [Listener at localhost/38793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:27,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e86807f85f0daaf: Processing first storage report for DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48 from datanode 3b6aa4fe-fea5-46a7-95c0-c1a91a417cfb 2023-02-12 00:03:27,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e86807f85f0daaf: from storage DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48 node DatanodeRegistration(127.0.0.1:44743, datanodeUuid=3b6aa4fe-fea5-46a7-95c0-c1a91a417cfb, infoPort=44311, infoSecurePort=0, ipcPort=38793, storageInfo=lv=-57;cid=testClusterID;nsid=1376321605;c=1676160206714), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:27,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e86807f85f0daaf: Processing first storage report for DS-6dfb44e6-5bad-4a67-91cc-f9710dda9b40 from datanode 3b6aa4fe-fea5-46a7-95c0-c1a91a417cfb 2023-02-12 00:03:27,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e86807f85f0daaf: from storage DS-6dfb44e6-5bad-4a67-91cc-f9710dda9b40 node DatanodeRegistration(127.0.0.1:44743, datanodeUuid=3b6aa4fe-fea5-46a7-95c0-c1a91a417cfb, infoPort=44311, infoSecurePort=0, ipcPort=38793, storageInfo=lv=-57;cid=testClusterID;nsid=1376321605;c=1676160206714), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:27,273 DEBUG [Listener at localhost/38793] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2 2023-02-12 00:03:27,276 INFO [Listener at localhost/38793] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/zookeeper_0, clientPort=52767, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:27,277 INFO [Listener at localhost/38793] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52767 2023-02-12 00:03:27,277 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,278 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,294 INFO [Listener at localhost/38793] util.FSUtils(479): Created version file at hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42 with version=8 2023-02-12 00:03:27,294 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,295 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,296 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/hbase-staging 2023-02-12 00:03:27,297 INFO [Listener at localhost/38793] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:27,298 INFO [Listener at localhost/38793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:27,299 INFO [Listener at localhost/38793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36145 2023-02-12 00:03:27,299 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,300 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,301 INFO [Listener at localhost/38793] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36145 connecting to ZooKeeper ensemble=127.0.0.1:52767 2023-02-12 00:03:27,308 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:361450x0, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:27,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36145-0x10045d7e9990000 connected 2023-02-12 00:03:27,325 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:27,326 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:27,326 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:27,327 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36145 2023-02-12 00:03:27,330 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36145 2023-02-12 00:03:27,330 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36145 2023-02-12 00:03:27,330 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36145 2023-02-12 00:03:27,330 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36145 2023-02-12 00:03:27,330 INFO [Listener at localhost/38793] master.HMaster(439): hbase.rootdir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42, hbase.cluster.distributed=false 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:27,346 INFO [Listener at localhost/38793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:27,347 INFO [Listener at localhost/38793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41655 2023-02-12 00:03:27,347 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:27,348 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:27,349 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,350 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,351 INFO [Listener at localhost/38793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41655 connecting to ZooKeeper ensemble=127.0.0.1:52767 2023-02-12 00:03:27,355 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:416550x0, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:27,357 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:416550x0, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:27,357 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:416550x0, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:27,358 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:416550x0, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:27,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41655-0x10045d7e9990001 connected 2023-02-12 00:03:27,359 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41655 2023-02-12 00:03:27,359 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41655 2023-02-12 00:03:27,363 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41655 2023-02-12 00:03:27,363 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41655 2023-02-12 00:03:27,364 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41655 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:27,375 INFO [Listener at localhost/38793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:27,377 INFO [Listener at localhost/38793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41835 2023-02-12 00:03:27,377 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:27,379 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:27,380 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,381 INFO [Listener at localhost/38793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,382 INFO [Listener at localhost/38793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41835 connecting to ZooKeeper ensemble=127.0.0.1:52767 2023-02-12 00:03:27,385 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:418350x0, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:27,387 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:418350x0, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:27,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41835-0x10045d7e9990002 connected 2023-02-12 00:03:27,387 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:27,388 DEBUG [Listener at localhost/38793] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:27,390 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41835 2023-02-12 00:03:27,391 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41835 2023-02-12 00:03:27,391 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41835 2023-02-12 00:03:27,395 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41835 2023-02-12 00:03:27,395 DEBUG [Listener at localhost/38793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41835 2023-02-12 00:03:27,396 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,399 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:27,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,401 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:27,401 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:27,401 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,401 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:27,402 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:27,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,36145,1676160207297 from backup master directory 2023-02-12 00:03:27,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:27,404 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,404 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:27,404 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,404 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:27,417 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/hbase.id with ID: 82a97a2d-f79d-4749-bee2-70ee87b8ae3d 2023-02-12 00:03:27,428 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:27,430 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,441 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f711dde to 127.0.0.1:52767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:27,450 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b50fc23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:27,451 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:27,451 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:27,451 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:27,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store-tmp 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:27,461 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:27,461 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:27,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160207461Disabling compacts and flushes for region at 1676160207461Disabling writes for close at 1676160207461Writing region close event to WAL at 1676160207461Closed at 1676160207461 2023-02-12 00:03:27,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/WALs/jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,464 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36145%2C1676160207297, suffix=, logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/WALs/jenkins-hbase9.apache.org,36145,1676160207297, archiveDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:27,478 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK] 2023-02-12 00:03:27,479 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK] 2023-02-12 00:03:27,482 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/WALs/jenkins-hbase9.apache.org,36145,1676160207297/jenkins-hbase9.apache.org%2C36145%2C1676160207297.1676160207464 2023-02-12 00:03:27,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK], DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK]] 2023-02-12 00:03:27,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:27,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:27,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,487 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,488 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:27,488 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:27,489 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,490 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,490 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,493 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:27,494 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:27,495 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72977812, jitterRate=0.08745414018630981}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:27,495 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160207482Initializing all the Stores at 1676160207483 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160207483Cleaning up temporary data from old regions at 1676160207491 (+8 ms)Cleaning up detritus from prior splits at 1676160207491Region opened successfully at 1676160207495 (+4 ms) 2023-02-12 00:03:27,499 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:27,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:27,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:27,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:27,501 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:27,501 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:27,501 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:27,502 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:27,503 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:27,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:27,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:27,513 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:27,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:27,514 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:27,516 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,517 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:27,517 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:27,518 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:27,519 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:27,519 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:27,519 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,519 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:27,519 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,36145,1676160207297, sessionid=0x10045d7e9990000, setting cluster-up flag (Was=false) 2023-02-12 00:03:27,526 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,529 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:27,530 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,533 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:27,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:27,539 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/.tmp 2023-02-12 00:03:27,540 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:27,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160237544 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:27,544 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:27,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,544 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:27,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:27,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:27,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:27,546 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160207546,5,FailOnTimeoutGroup] 2023-02-12 00:03:27,546 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160207546,5,FailOnTimeoutGroup] 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,546 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:27,558 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:27,559 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:27,559 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42 2023-02-12 00:03:27,567 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:27,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:27,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/info 2023-02-12 00:03:27,569 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:27,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:27,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:27,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:27,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:27,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/table 2023-02-12 00:03:27,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:27,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,574 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740 2023-02-12 00:03:27,574 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740 2023-02-12 00:03:27,576 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:27,577 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:27,578 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:27,578 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60839140, jitterRate=-0.0934261679649353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:27,578 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160207567Initializing all the Stores at 1676160207568 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160207568Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160207568Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160207568Cleaning up temporary data from old regions at 1676160207575 (+7 ms)Cleaning up detritus from prior splits at 1676160207575Region opened successfully at 1676160207578 (+3 ms) 2023-02-12 00:03:27,578 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:27,578 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:27,579 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:27,579 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:27,579 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:27,579 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:27,579 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160207578Disabling compacts and flushes for region at 1676160207578Disabling writes for close at 1676160207579 (+1 ms)Writing region close event to WAL at 1676160207579Closed at 1676160207579 2023-02-12 00:03:27,579 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:27,580 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:27,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:27,581 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:27,582 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:27,597 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(952): ClusterId : 82a97a2d-f79d-4749-bee2-70ee87b8ae3d 2023-02-12 00:03:27,597 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(952): ClusterId : 82a97a2d-f79d-4749-bee2-70ee87b8ae3d 2023-02-12 00:03:27,597 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:27,597 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:27,599 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:27,599 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:27,599 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:27,599 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:27,601 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:27,602 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:27,602 DEBUG [RS:1;jenkins-hbase9:41835] zookeeper.ReadOnlyZKClient(139): Connect 0x147e08f4 to 127.0.0.1:52767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:27,603 DEBUG [RS:0;jenkins-hbase9:41655] zookeeper.ReadOnlyZKClient(139): Connect 0x42c695a9 to 127.0.0.1:52767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:27,618 DEBUG [RS:1;jenkins-hbase9:41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ab9f40b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:27,618 DEBUG [RS:0;jenkins-hbase9:41655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c017381, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:27,619 DEBUG [RS:1;jenkins-hbase9:41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e866384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:27,619 DEBUG [RS:0;jenkins-hbase9:41655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@483efed9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:27,633 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41655 2023-02-12 00:03:27,633 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:41835 2023-02-12 00:03:27,633 INFO [RS:0;jenkins-hbase9:41655] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:27,633 INFO [RS:0;jenkins-hbase9:41655] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:27,633 INFO [RS:1;jenkins-hbase9:41835] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:27,633 INFO [RS:1;jenkins-hbase9:41835] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:27,633 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:27,633 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:27,633 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,36145,1676160207297 with isa=jenkins-hbase9.apache.org/172.31.2.10:41835, startcode=1676160207374 2023-02-12 00:03:27,633 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,36145,1676160207297 with isa=jenkins-hbase9.apache.org/172.31.2.10:41655, startcode=1676160207345 2023-02-12 00:03:27,633 DEBUG [RS:1;jenkins-hbase9:41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:27,634 DEBUG [RS:0;jenkins-hbase9:41655] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:27,636 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56061, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:27,636 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49935, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:27,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36145] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,638 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42 2023-02-12 00:03:27,638 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46745 2023-02-12 00:03:27,638 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:27,639 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42 2023-02-12 00:03:27,639 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46745 2023-02-12 00:03:27,639 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:27,640 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:27,643 DEBUG [RS:1;jenkins-hbase9:41835] zookeeper.ZKUtil(162): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,643 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41835,1676160207374] 2023-02-12 00:03:27,643 WARN [RS:1;jenkins-hbase9:41835] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:27,643 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41655,1676160207345] 2023-02-12 00:03:27,643 DEBUG [RS:0;jenkins-hbase9:41655] zookeeper.ZKUtil(162): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,643 INFO [RS:1;jenkins-hbase9:41835] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:27,643 WARN [RS:0;jenkins-hbase9:41655] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:27,643 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,643 INFO [RS:0;jenkins-hbase9:41655] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:27,643 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,647 DEBUG [RS:0;jenkins-hbase9:41655] zookeeper.ZKUtil(162): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,647 DEBUG [RS:1;jenkins-hbase9:41835] zookeeper.ZKUtil(162): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,648 DEBUG [RS:0;jenkins-hbase9:41655] zookeeper.ZKUtil(162): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,648 DEBUG [RS:1;jenkins-hbase9:41835] zookeeper.ZKUtil(162): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,648 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:27,648 DEBUG [RS:1;jenkins-hbase9:41835] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:27,649 INFO [RS:0;jenkins-hbase9:41655] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:27,649 INFO [RS:1;jenkins-hbase9:41835] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:27,650 INFO [RS:0;jenkins-hbase9:41655] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:27,651 INFO [RS:0;jenkins-hbase9:41655] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:27,651 INFO [RS:1;jenkins-hbase9:41835] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:27,651 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,651 INFO [RS:1;jenkins-hbase9:41835] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:27,651 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:27,651 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,652 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:27,653 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,653 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,653 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,654 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:27,655 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:0;jenkins-hbase9:41655] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,655 DEBUG [RS:1;jenkins-hbase9:41835] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:27,659 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,659 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,659 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,663 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,663 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,663 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,670 INFO [RS:0;jenkins-hbase9:41655] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:27,670 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41655,1676160207345-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,673 INFO [RS:1;jenkins-hbase9:41835] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:27,673 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41835,1676160207374-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,683 INFO [RS:0;jenkins-hbase9:41655] regionserver.Replication(203): jenkins-hbase9.apache.org,41655,1676160207345 started 2023-02-12 00:03:27,683 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41655,1676160207345, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41655, sessionid=0x10045d7e9990001 2023-02-12 00:03:27,684 INFO [RS:1;jenkins-hbase9:41835] regionserver.Replication(203): jenkins-hbase9.apache.org,41835,1676160207374 started 2023-02-12 00:03:27,684 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:27,684 DEBUG [RS:0;jenkins-hbase9:41655] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,684 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41655,1676160207345' 2023-02-12 00:03:27,684 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:27,684 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41835,1676160207374, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41835, sessionid=0x10045d7e9990002 2023-02-12 00:03:27,684 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:27,684 DEBUG [RS:1;jenkins-hbase9:41835] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,684 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41835,1676160207374' 2023-02-12 00:03:27,684 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:27,684 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41655,1676160207345' 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41835,1676160207374' 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:27,685 DEBUG [RS:0;jenkins-hbase9:41655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:27,685 DEBUG [RS:1;jenkins-hbase9:41835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:27,686 DEBUG [RS:0;jenkins-hbase9:41655] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:27,686 INFO [RS:0;jenkins-hbase9:41655] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:27,686 DEBUG [RS:1;jenkins-hbase9:41835] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:27,686 INFO [RS:0;jenkins-hbase9:41655] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:27,686 INFO [RS:1;jenkins-hbase9:41835] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:27,686 INFO [RS:1;jenkins-hbase9:41835] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:27,732 DEBUG [jenkins-hbase9:36145] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:27,732 DEBUG [jenkins-hbase9:36145] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:27,734 DEBUG [jenkins-hbase9:36145] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:27,734 DEBUG [jenkins-hbase9:36145] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:27,734 DEBUG [jenkins-hbase9:36145] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:27,735 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41655,1676160207345, state=OPENING 2023-02-12 00:03:27,738 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:27,739 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:27,739 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:27,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:27,893 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:27,894 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:27,895 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:27,899 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:27,899 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:27,901 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41655%2C1676160207345.meta, suffix=.meta, logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41655,1676160207345, archiveDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs, maxLogs=32 2023-02-12 00:03:27,916 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK] 2023-02-12 00:03:27,916 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK] 2023-02-12 00:03:27,918 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41655,1676160207345/jenkins-hbase9.apache.org%2C41655%2C1676160207345.meta.1676160207901.meta 2023-02-12 00:03:27,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK], DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK]] 2023-02-12 00:03:27,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:27,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:27,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:27,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:27,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:27,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:27,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:27,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:27,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:27,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/info 2023-02-12 00:03:27,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/info 2023-02-12 00:03:27,921 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:27,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:27,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:27,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:27,923 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:27,923 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,923 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:27,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/table 2023-02-12 00:03:27,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/table 2023-02-12 00:03:27,924 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:27,925 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:27,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740 2023-02-12 00:03:27,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740 2023-02-12 00:03:27,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:27,929 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:27,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63263259, jitterRate=-0.057303979992866516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:27,930 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160207919Writing region info on filesystem at 1676160207919Initializing all the Stores at 1676160207920 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160207920Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160207920Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160207920Cleaning up temporary data from old regions at 1676160207927 (+7 ms)Cleaning up detritus from prior splits at 1676160207928 (+1 ms)Running coprocessor post-open hooks at 1676160207930 (+2 ms)Region opened successfully at 1676160207930 2023-02-12 00:03:27,931 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160207893 2023-02-12 00:03:27,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:27,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:27,936 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41655,1676160207345, state=OPEN 2023-02-12 00:03:27,937 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:27,937 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:27,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:27,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41655,1676160207345 in 198 msec 2023-02-12 00:03:27,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:27,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-12 00:03:27,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-12 00:03:27,942 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160207400, completionTime=-1 2023-02-12 00:03:27,942 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:27,942 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:27,944 DEBUG [hconnection-0x60da51f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:27,946 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48782, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:27,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:27,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160267947 2023-02-12 00:03:27,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160327947 2023-02-12 00:03:27,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 00:03:27,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36145,1676160207297-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36145,1676160207297-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36145,1676160207297-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:36145, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:27,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:27,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:27,956 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:27,957 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:27,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:27,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:27,960 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:27,961 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3 empty. 2023-02-12 00:03:27,961 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:27,961 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:27,973 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:27,974 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a99219206ff4bfc2b8ee5e29953c39c3, NAME => 'hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a99219206ff4bfc2b8ee5e29953c39c3, disabling compactions & flushes 2023-02-12 00:03:27,985 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. after waiting 0 ms 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:27,985 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:27,985 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a99219206ff4bfc2b8ee5e29953c39c3: Waiting for close lock at 1676160207985Disabling compacts and flushes for region at 1676160207985Disabling writes for close at 1676160207985Writing region close event to WAL at 1676160207985Closed at 1676160207985 2023-02-12 00:03:27,987 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:27,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160207988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160207988"}]},"ts":"1676160207988"} 2023-02-12 00:03:27,990 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:27,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:27,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160207991"}]},"ts":"1676160207991"} 2023-02-12 00:03:27,992 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:27,995 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:27,995 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:27,995 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:27,995 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:27,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a99219206ff4bfc2b8ee5e29953c39c3, ASSIGN}] 2023-02-12 00:03:28,000 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a99219206ff4bfc2b8ee5e29953c39c3, ASSIGN 2023-02-12 00:03:28,001 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a99219206ff4bfc2b8ee5e29953c39c3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:28,152 INFO [jenkins-hbase9:36145] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:28,153 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a99219206ff4bfc2b8ee5e29953c39c3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:28,153 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160208153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160208153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160208153"}]},"ts":"1676160208153"} 2023-02-12 00:03:28,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a99219206ff4bfc2b8ee5e29953c39c3, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:28,311 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:28,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41655%2C1676160207345, suffix=, logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41655,1676160207345, archiveDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs, maxLogs=32 2023-02-12 00:03:28,330 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK] 2023-02-12 00:03:28,330 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK] 2023-02-12 00:03:28,333 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41655,1676160207345/jenkins-hbase9.apache.org%2C41655%2C1676160207345.1676160208312 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK], DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK]] 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a99219206ff4bfc2b8ee5e29953c39c3, NAME => 'hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,337 INFO [StoreOpener-a99219206ff4bfc2b8ee5e29953c39c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,339 DEBUG [StoreOpener-a99219206ff4bfc2b8ee5e29953c39c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/info 2023-02-12 00:03:28,339 DEBUG [StoreOpener-a99219206ff4bfc2b8ee5e29953c39c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/info 2023-02-12 00:03:28,339 INFO [StoreOpener-a99219206ff4bfc2b8ee5e29953c39c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a99219206ff4bfc2b8ee5e29953c39c3 columnFamilyName info 2023-02-12 00:03:28,340 INFO [StoreOpener-a99219206ff4bfc2b8ee5e29953c39c3-1] regionserver.HStore(310): Store=a99219206ff4bfc2b8ee5e29953c39c3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:28,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,343 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:28,348 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:28,348 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a99219206ff4bfc2b8ee5e29953c39c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64186197, jitterRate=-0.04355113208293915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:28,348 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a99219206ff4bfc2b8ee5e29953c39c3: Running coprocessor pre-open hook at 1676160208335Writing region info on filesystem at 1676160208335Initializing all the Stores at 1676160208336 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160208336Cleaning up temporary data from old regions at 1676160208341 (+5 ms)Cleaning up detritus from prior splits at 1676160208341Running coprocessor post-open hooks at 1676160208348 (+7 ms)Region opened successfully at 1676160208348 2023-02-12 00:03:28,349 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3., pid=6, masterSystemTime=1676160208307 2023-02-12 00:03:28,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:28,352 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:28,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a99219206ff4bfc2b8ee5e29953c39c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:28,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160208352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160208352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160208352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160208352"}]},"ts":"1676160208352"} 2023-02-12 00:03:28,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:28,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a99219206ff4bfc2b8ee5e29953c39c3, server=jenkins-hbase9.apache.org,41655,1676160207345 in 199 msec 2023-02-12 00:03:28,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:28,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a99219206ff4bfc2b8ee5e29953c39c3, ASSIGN in 360 msec 2023-02-12 00:03:28,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:28,358 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160208357"}]},"ts":"1676160208357"} 2023-02-12 00:03:28,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:28,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:28,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 405 msec 2023-02-12 00:03:28,458 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:28,460 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:28,461 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:28,464 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:28,472 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:28,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 00:03:28,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:28,482 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:28,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-12 00:03:28,490 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:28,493 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:28,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.089sec 2023-02-12 00:03:28,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:28,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:28,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:28,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36145,1676160207297-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:28,494 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36145,1676160207297-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:28,495 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:28,499 DEBUG [Listener at localhost/38793] zookeeper.ReadOnlyZKClient(139): Connect 0x6a1d4d69 to 127.0.0.1:52767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:28,503 DEBUG [Listener at localhost/38793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68e37242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:28,505 DEBUG [hconnection-0x2fa3ce60-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:28,506 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48798, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:28,507 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:28,508 DEBUG [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:28,509 DEBUG [Listener at localhost/38793] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:28,510 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:28,511 INFO [Listener at localhost/38793] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 00:03:28,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-12 00:03:28,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:28,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.10:56362 deadline: 1676160268511, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-12 00:03:28,512 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-12 00:03:28,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:28,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:28,516 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:28,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-12 00:03:28,516 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:28,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:28,524 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 empty. 2023-02-12 00:03:28,525 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 empty. 2023-02-12 00:03:28,526 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e empty. 2023-02-12 00:03:28,526 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 empty. 2023-02-12 00:03:28,526 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 empty. 2023-02-12 00:03:28,526 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf empty. 2023-02-12 00:03:28,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 empty. 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc empty. 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:28,528 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 empty. 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c empty. 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:28,529 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:28,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 00:03:28,538 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:28,539 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 964327a1b0f6ad05f91a89d74776ec07, NAME => 'testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,544 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => f31a13eccfd65e5fe1df5ad209ac0da0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,544 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => b87a34a4b86d36c38b4d76281c22acbf, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,560 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,560 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 964327a1b0f6ad05f91a89d74776ec07, disabling compactions & flushes 2023-02-12 00:03:28,560 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:28,560 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:28,560 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. after waiting 0 ms 2023-02-12 00:03:28,560 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:28,561 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:28,561 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 964327a1b0f6ad05f91a89d74776ec07: Waiting for close lock at 1676160208560Disabling compacts and flushes for region at 1676160208560Disabling writes for close at 1676160208560Writing region close event to WAL at 1676160208561 (+1 ms)Closed at 1676160208561 2023-02-12 00:03:28,561 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,561 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing f31a13eccfd65e5fe1df5ad209ac0da0, disabling compactions & flushes 2023-02-12 00:03:28,561 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 55d66e74d9e7592b55b82b07566fa7a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,561 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:28,561 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:28,561 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. after waiting 0 ms 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:28,562 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for f31a13eccfd65e5fe1df5ad209ac0da0: Waiting for close lock at 1676160208561Disabling compacts and flushes for region at 1676160208561Disabling writes for close at 1676160208562 (+1 ms)Writing region close event to WAL at 1676160208562Closed at 1676160208562 2023-02-12 00:03:28,562 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => cfeb4ce153992da2963d9666d37081bc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing b87a34a4b86d36c38b4d76281c22acbf, disabling compactions & flushes 2023-02-12 00:03:28,562 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. after waiting 0 ms 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:28,562 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:28,562 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for b87a34a4b86d36c38b4d76281c22acbf: Waiting for close lock at 1676160208562Disabling compacts and flushes for region at 1676160208562Disabling writes for close at 1676160208562Writing region close event to WAL at 1676160208562Closed at 1676160208562 2023-02-12 00:03:28,563 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e64fb799d292322bdadaa323edd87f74, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,577 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e64fb799d292322bdadaa323edd87f74, disabling compactions & flushes 2023-02-12 00:03:28,578 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:28,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:28,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. after waiting 0 ms 2023-02-12 00:03:28,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:28,578 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:28,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e64fb799d292322bdadaa323edd87f74: Waiting for close lock at 1676160208578Disabling compacts and flushes for region at 1676160208578Disabling writes for close at 1676160208578Writing region close event to WAL at 1676160208578Closed at 1676160208578 2023-02-12 00:03:28,578 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1e1dfc1b1d3b6956b57ea012d19919a9, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 55d66e74d9e7592b55b82b07566fa7a3, disabling compactions & flushes 2023-02-12 00:03:28,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. after waiting 0 ms 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:28,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:28,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 55d66e74d9e7592b55b82b07566fa7a3: Waiting for close lock at 1676160208579Disabling compacts and flushes for region at 1676160208579Disabling writes for close at 1676160208579Writing region close event to WAL at 1676160208579Closed at 1676160208579 2023-02-12 00:03:28,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1fb5c28e2c7acbd3022b4552c4e1f78e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing cfeb4ce153992da2963d9666d37081bc, disabling compactions & flushes 2023-02-12 00:03:28,583 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. after waiting 0 ms 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:28,583 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:28,583 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for cfeb4ce153992da2963d9666d37081bc: Waiting for close lock at 1676160208583Disabling compacts and flushes for region at 1676160208583Disabling writes for close at 1676160208583Writing region close event to WAL at 1676160208583Closed at 1676160208583 2023-02-12 00:03:28,584 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7c164096fdc52b41c29486a367210d62, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,601 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,601 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1e1dfc1b1d3b6956b57ea012d19919a9, disabling compactions & flushes 2023-02-12 00:03:28,601 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. after waiting 0 ms 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:28,602 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Waiting for close lock at 1676160208601Disabling compacts and flushes for region at 1676160208601Disabling writes for close at 1676160208602 (+1 ms)Writing region close event to WAL at 1676160208602Closed at 1676160208602 2023-02-12 00:03:28,602 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => a401afb0c77ad416e6b25e0324e1a35c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 1fb5c28e2c7acbd3022b4552c4e1f78e, disabling compactions & flushes 2023-02-12 00:03:28,602 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. after waiting 0 ms 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:28,602 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:28,602 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Waiting for close lock at 1676160208602Disabling compacts and flushes for region at 1676160208602Disabling writes for close at 1676160208602Writing region close event to WAL at 1676160208602Closed at 1676160208602 2023-02-12 00:03:28,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:28,688 INFO [RS:1;jenkins-hbase9:41835] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41835%2C1676160207374, suffix=, logDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41835,1676160207374, archiveDir=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs, maxLogs=32 2023-02-12 00:03:28,703 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK] 2023-02-12 00:03:28,703 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK] 2023-02-12 00:03:28,705 INFO [RS:1;jenkins-hbase9:41835] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/WALs/jenkins-hbase9.apache.org,41835,1676160207374/jenkins-hbase9.apache.org%2C41835%2C1676160207374.1676160208688 2023-02-12 00:03:28,705 DEBUG [RS:1;jenkins-hbase9:41835] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45085,DS-c2145750-22ca-486b-9215-6c91e287e274,DISK], DatanodeInfoWithStorage[127.0.0.1:44743,DS-1c4fcf7d-7605-45bf-a6f8-a01f49f89c48,DISK]] 2023-02-12 00:03:28,719 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:28,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 7c164096fdc52b41c29486a367210d62, disabling compactions & flushes 2023-02-12 00:03:29,004 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. after waiting 0 ms 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,004 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,004 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 7c164096fdc52b41c29486a367210d62: Waiting for close lock at 1676160209004Disabling compacts and flushes for region at 1676160209004Disabling writes for close at 1676160209004Writing region close event to WAL at 1676160209004Closed at 1676160209004 2023-02-12 00:03:29,009 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,010 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing a401afb0c77ad416e6b25e0324e1a35c, disabling compactions & flushes 2023-02-12 00:03:29,010 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,010 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,010 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. after waiting 0 ms 2023-02-12 00:03:29,010 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,010 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,010 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for a401afb0c77ad416e6b25e0324e1a35c: Waiting for close lock at 1676160209010Disabling compacts and flushes for region at 1676160209010Disabling writes for close at 1676160209010Writing region close event to WAL at 1676160209010Closed at 1676160209010 2023-02-12 00:03:29,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160209013"}]},"ts":"1676160209013"} 2023-02-12 00:03:29,015 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 00:03:29,016 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:29,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160209016"}]},"ts":"1676160209016"} 2023-02-12 00:03:29,017 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-12 00:03:29,020 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:29,025 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:29,025 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:29,025 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:29,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, ASSIGN}] 2023-02-12 00:03:29,027 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, ASSIGN 2023-02-12 00:03:29,027 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, ASSIGN 2023-02-12 00:03:29,027 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, ASSIGN 2023-02-12 00:03:29,028 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, ASSIGN 2023-02-12 00:03:29,028 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:29,028 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41835,1676160207374; forceNewPlan=false, retain=false 2023-02-12 00:03:29,028 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41835,1676160207374; forceNewPlan=false, retain=false 2023-02-12 00:03:29,028 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41835,1676160207374; forceNewPlan=false, retain=false 2023-02-12 00:03:29,028 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, ASSIGN 2023-02-12 00:03:29,029 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, ASSIGN 2023-02-12 00:03:29,029 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, ASSIGN 2023-02-12 00:03:29,029 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, ASSIGN 2023-02-12 00:03:29,029 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, ASSIGN 2023-02-12 00:03:29,029 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:29,029 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41835,1676160207374; forceNewPlan=false, retain=false 2023-02-12 00:03:29,029 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:29,030 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41835,1676160207374; forceNewPlan=false, retain=false 2023-02-12 00:03:29,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, ASSIGN 2023-02-12 00:03:29,030 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:29,030 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41655,1676160207345; forceNewPlan=false, retain=false 2023-02-12 00:03:29,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:29,178 INFO [jenkins-hbase9:36145] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 00:03:29,184 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=964327a1b0f6ad05f91a89d74776ec07, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,184 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=55d66e74d9e7592b55b82b07566fa7a3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1e1dfc1b1d3b6956b57ea012d19919a9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,184 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7c164096fdc52b41c29486a367210d62, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b87a34a4b86d36c38b4d76281c22acbf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,184 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209184"}]},"ts":"1676160209184"} 2023-02-12 00:03:29,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209184"}]},"ts":"1676160209184"} 2023-02-12 00:03:29,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209184"}]},"ts":"1676160209184"} 2023-02-12 00:03:29,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209184"}]},"ts":"1676160209184"} 2023-02-12 00:03:29,184 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209184"}]},"ts":"1676160209184"} 2023-02-12 00:03:29,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure b87a34a4b86d36c38b4d76281c22acbf, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:29,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure 7c164096fdc52b41c29486a367210d62, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:29,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 1e1dfc1b1d3b6956b57ea012d19919a9, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:29,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 55d66e74d9e7592b55b82b07566fa7a3, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:29,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure 964327a1b0f6ad05f91a89d74776ec07, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:29,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1fb5c28e2c7acbd3022b4552c4e1f78e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,190 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209189"}]},"ts":"1676160209189"} 2023-02-12 00:03:29,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a401afb0c77ad416e6b25e0324e1a35c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209191"}]},"ts":"1676160209191"} 2023-02-12 00:03:29,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 1fb5c28e2c7acbd3022b4552c4e1f78e, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:29,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e64fb799d292322bdadaa323edd87f74, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209192"}]},"ts":"1676160209192"} 2023-02-12 00:03:29,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure a401afb0c77ad416e6b25e0324e1a35c, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:29,193 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f31a13eccfd65e5fe1df5ad209ac0da0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,193 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209193"}]},"ts":"1676160209193"} 2023-02-12 00:03:29,194 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cfeb4ce153992da2963d9666d37081bc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure e64fb799d292322bdadaa323edd87f74, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:29,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160209193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160209193"}]},"ts":"1676160209193"} 2023-02-12 00:03:29,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure f31a13eccfd65e5fe1df5ad209ac0da0, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:29,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure cfeb4ce153992da2963d9666d37081bc, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:29,338 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,338 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:29,340 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:29,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7c164096fdc52b41c29486a367210d62, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 00:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,346 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f31a13eccfd65e5fe1df5ad209ac0da0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 00:03:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,348 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1 2023-02-12 00:03:29,348 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1 2023-02-12 00:03:29,348 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c164096fdc52b41c29486a367210d62 columnFamilyName f1 2023-02-12 00:03:29,349 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,349 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(310): Store=7c164096fdc52b41c29486a367210d62/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,349 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,350 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1 2023-02-12 00:03:29,350 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1 2023-02-12 00:03:29,351 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2 2023-02-12 00:03:29,351 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2 2023-02-12 00:03:29,351 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f31a13eccfd65e5fe1df5ad209ac0da0 columnFamilyName f1 2023-02-12 00:03:29,351 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c164096fdc52b41c29486a367210d62 columnFamilyName f2 2023-02-12 00:03:29,351 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(310): Store=f31a13eccfd65e5fe1df5ad209ac0da0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,351 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(310): Store=7c164096fdc52b41c29486a367210d62/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,351 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,353 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2 2023-02-12 00:03:29,353 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2 2023-02-12 00:03:29,353 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f31a13eccfd65e5fe1df5ad209ac0da0 columnFamilyName f2 2023-02-12 00:03:29,353 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(310): Store=f31a13eccfd65e5fe1df5ad209ac0da0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:29,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:29,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7c164096fdc52b41c29486a367210d62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62699358, jitterRate=-0.0657067596912384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7c164096fdc52b41c29486a367210d62: Running coprocessor pre-open hook at 1676160209344Writing region info on filesystem at 1676160209344Initializing all the Stores at 1676160209345 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209345Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209345Cleaning up temporary data from old regions at 1676160209353 (+8 ms)Cleaning up detritus from prior splits at 1676160209353Running coprocessor post-open hooks at 1676160209358 (+5 ms)Region opened successfully at 1676160209358 2023-02-12 00:03:29,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62., pid=22, masterSystemTime=1676160209338 2023-02-12 00:03:29,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f31a13eccfd65e5fe1df5ad209ac0da0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72193354, jitterRate=0.07576480507850647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f31a13eccfd65e5fe1df5ad209ac0da0: Running coprocessor pre-open hook at 1676160209347Writing region info on filesystem at 1676160209347Initializing all the Stores at 1676160209348 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209348Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209348Cleaning up temporary data from old regions at 1676160209355 (+7 ms)Cleaning up detritus from prior splits at 1676160209356 (+1 ms)Running coprocessor post-open hooks at 1676160209362 (+6 ms)Region opened successfully at 1676160209362 2023-02-12 00:03:29,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0., pid=29, masterSystemTime=1676160209343 2023-02-12 00:03:29,363 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7c164096fdc52b41c29486a367210d62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,363 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209363"}]},"ts":"1676160209363"} 2023-02-12 00:03:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cfeb4ce153992da2963d9666d37081bc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 00:03:29,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f31a13eccfd65e5fe1df5ad209ac0da0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,365 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209365"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209365"}]},"ts":"1676160209365"} 2023-02-12 00:03:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-12 00:03:29,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure 7c164096fdc52b41c29486a367210d62, server=jenkins-hbase9.apache.org,41835,1676160207374 in 178 msec 2023-02-12 00:03:29,367 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 964327a1b0f6ad05f91a89d74776ec07, NAME => 'testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 00:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,369 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1 2023-02-12 00:03:29,369 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1 2023-02-12 00:03:29,369 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeb4ce153992da2963d9666d37081bc columnFamilyName f1 2023-02-12 00:03:29,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, ASSIGN in 341 msec 2023-02-12 00:03:29,370 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(310): Store=cfeb4ce153992da2963d9666d37081bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,370 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-12 00:03:29,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure f31a13eccfd65e5fe1df5ad209ac0da0, server=jenkins-hbase9.apache.org,41655,1676160207345 in 171 msec 2023-02-12 00:03:29,371 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2 2023-02-12 00:03:29,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, ASSIGN in 345 msec 2023-02-12 00:03:29,371 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2 2023-02-12 00:03:29,371 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeb4ce153992da2963d9666d37081bc columnFamilyName f2 2023-02-12 00:03:29,372 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,372 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(310): Store=cfeb4ce153992da2963d9666d37081bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,373 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f1 2023-02-12 00:03:29,373 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f1 2023-02-12 00:03:29,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,373 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964327a1b0f6ad05f91a89d74776ec07 columnFamilyName f1 2023-02-12 00:03:29,373 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(310): Store=964327a1b0f6ad05f91a89d74776ec07/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,374 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,375 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f2 2023-02-12 00:03:29,375 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f2 2023-02-12 00:03:29,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,375 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964327a1b0f6ad05f91a89d74776ec07 columnFamilyName f2 2023-02-12 00:03:29,376 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(310): Store=964327a1b0f6ad05f91a89d74776ec07/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:29,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened cfeb4ce153992da2963d9666d37081bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60411744, jitterRate=-0.09979486465454102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for cfeb4ce153992da2963d9666d37081bc: Running coprocessor pre-open hook at 1676160209365Writing region info on filesystem at 1676160209365Initializing all the Stores at 1676160209366 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209366Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209366Cleaning up temporary data from old regions at 1676160209374 (+8 ms)Cleaning up detritus from prior splits at 1676160209374Running coprocessor post-open hooks at 1676160209379 (+5 ms)Region opened successfully at 1676160209379 2023-02-12 00:03:29,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:29,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 964327a1b0f6ad05f91a89d74776ec07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71275418, jitterRate=0.06208649277687073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 964327a1b0f6ad05f91a89d74776ec07: Running coprocessor pre-open hook at 1676160209368Writing region info on filesystem at 1676160209368Initializing all the Stores at 1676160209369 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209369Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209371 (+2 ms)Cleaning up temporary data from old regions at 1676160209377 (+6 ms)Cleaning up detritus from prior splits at 1676160209378 (+1 ms)Running coprocessor post-open hooks at 1676160209381 (+3 ms)Region opened successfully at 1676160209381 2023-02-12 00:03:29,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07., pid=25, masterSystemTime=1676160209338 2023-02-12 00:03:29,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc., pid=30, masterSystemTime=1676160209343 2023-02-12 00:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:29,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:29,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b87a34a4b86d36c38b4d76281c22acbf, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 00:03:29,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=964327a1b0f6ad05f91a89d74776ec07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209384"}]},"ts":"1676160209384"} 2023-02-12 00:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:29,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1fb5c28e2c7acbd3022b4552c4e1f78e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 00:03:29,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cfeb4ce153992da2963d9666d37081bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209385"}]},"ts":"1676160209385"} 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,386 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,387 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,388 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1 2023-02-12 00:03:29,388 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1 2023-02-12 00:03:29,389 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b87a34a4b86d36c38b4d76281c22acbf columnFamilyName f1 2023-02-12 00:03:29,389 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1 2023-02-12 00:03:29,389 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1 2023-02-12 00:03:29,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-12 00:03:29,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure 964327a1b0f6ad05f91a89d74776ec07, server=jenkins-hbase9.apache.org,41835,1676160207374 in 197 msec 2023-02-12 00:03:29,389 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb5c28e2c7acbd3022b4552c4e1f78e columnFamilyName f1 2023-02-12 00:03:29,389 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(310): Store=b87a34a4b86d36c38b4d76281c22acbf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,390 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,390 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(310): Store=1fb5c28e2c7acbd3022b4552c4e1f78e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,390 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-12 00:03:29,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure cfeb4ce153992da2963d9666d37081bc, server=jenkins-hbase9.apache.org,41655,1676160207345 in 192 msec 2023-02-12 00:03:29,391 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2 2023-02-12 00:03:29,391 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2 2023-02-12 00:03:29,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, ASSIGN in 364 msec 2023-02-12 00:03:29,391 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b87a34a4b86d36c38b4d76281c22acbf columnFamilyName f2 2023-02-12 00:03:29,392 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2 2023-02-12 00:03:29,392 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2 2023-02-12 00:03:29,392 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb5c28e2c7acbd3022b4552c4e1f78e columnFamilyName f2 2023-02-12 00:03:29,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, ASSIGN in 366 msec 2023-02-12 00:03:29,392 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(310): Store=b87a34a4b86d36c38b4d76281c22acbf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,392 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(310): Store=1fb5c28e2c7acbd3022b4552c4e1f78e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:29,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:29,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened b87a34a4b86d36c38b4d76281c22acbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59769749, jitterRate=-0.10936133563518524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1fb5c28e2c7acbd3022b4552c4e1f78e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66210953, jitterRate=-0.013379916548728943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for b87a34a4b86d36c38b4d76281c22acbf: Running coprocessor pre-open hook at 1676160209385Writing region info on filesystem at 1676160209385Initializing all the Stores at 1676160209385Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209385Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209386 (+1 ms)Cleaning up temporary data from old regions at 1676160209394 (+8 ms)Cleaning up detritus from prior splits at 1676160209394Running coprocessor post-open hooks at 1676160209404 (+10 ms)Region opened successfully at 1676160209404 2023-02-12 00:03:29,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Running coprocessor pre-open hook at 1676160209385Writing region info on filesystem at 1676160209385Initializing all the Stores at 1676160209387 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209387Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209387Cleaning up temporary data from old regions at 1676160209394 (+7 ms)Cleaning up detritus from prior splits at 1676160209395 (+1 ms)Running coprocessor post-open hooks at 1676160209404 (+9 ms)Region opened successfully at 1676160209404 2023-02-12 00:03:29,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf., pid=21, masterSystemTime=1676160209338 2023-02-12 00:03:29,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e., pid=26, masterSystemTime=1676160209343 2023-02-12 00:03:29,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:29,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:29,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:29,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1e1dfc1b1d3b6956b57ea012d19919a9, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 00:03:29,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,409 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b87a34a4b86d36c38b4d76281c22acbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,409 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,409 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209409"}]},"ts":"1676160209409"} 2023-02-12 00:03:29,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:29,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:29,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1fb5c28e2c7acbd3022b4552c4e1f78e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a401afb0c77ad416e6b25e0324e1a35c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 00:03:29,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209410"}]},"ts":"1676160209410"} 2023-02-12 00:03:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,411 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1 2023-02-12 00:03:29,411 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1 2023-02-12 00:03:29,412 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e1dfc1b1d3b6956b57ea012d19919a9 columnFamilyName f1 2023-02-12 00:03:29,412 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,412 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(310): Store=1e1dfc1b1d3b6956b57ea012d19919a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,412 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-12 00:03:29,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure b87a34a4b86d36c38b4d76281c22acbf, server=jenkins-hbase9.apache.org,41835,1676160207374 in 225 msec 2023-02-12 00:03:29,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-12 00:03:29,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 1fb5c28e2c7acbd3022b4552c4e1f78e, server=jenkins-hbase9.apache.org,41655,1676160207345 in 221 msec 2023-02-12 00:03:29,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, ASSIGN in 388 msec 2023-02-12 00:03:29,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, ASSIGN in 389 msec 2023-02-12 00:03:29,416 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f1 2023-02-12 00:03:29,416 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f1 2023-02-12 00:03:29,416 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2 2023-02-12 00:03:29,416 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2 2023-02-12 00:03:29,416 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a401afb0c77ad416e6b25e0324e1a35c columnFamilyName f1 2023-02-12 00:03:29,416 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e1dfc1b1d3b6956b57ea012d19919a9 columnFamilyName f2 2023-02-12 00:03:29,417 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(310): Store=a401afb0c77ad416e6b25e0324e1a35c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,417 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(310): Store=1e1dfc1b1d3b6956b57ea012d19919a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,417 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,418 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f2 2023-02-12 00:03:29,418 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f2 2023-02-12 00:03:29,418 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a401afb0c77ad416e6b25e0324e1a35c columnFamilyName f2 2023-02-12 00:03:29,419 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(310): Store=a401afb0c77ad416e6b25e0324e1a35c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:29,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a401afb0c77ad416e6b25e0324e1a35c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66735194, jitterRate=-0.005568116903305054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a401afb0c77ad416e6b25e0324e1a35c: Running coprocessor pre-open hook at 1676160209410Writing region info on filesystem at 1676160209410Initializing all the Stores at 1676160209411 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209411Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209411Cleaning up temporary data from old regions at 1676160209421 (+10 ms)Cleaning up detritus from prior splits at 1676160209421Running coprocessor post-open hooks at 1676160209427 (+6 ms)Region opened successfully at 1676160209427 2023-02-12 00:03:29,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c., pid=27, masterSystemTime=1676160209343 2023-02-12 00:03:29,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:29,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a401afb0c77ad416e6b25e0324e1a35c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160209431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209431"}]},"ts":"1676160209431"} 2023-02-12 00:03:29,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1e1dfc1b1d3b6956b57ea012d19919a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63661917, jitterRate=-0.0513635128736496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Running coprocessor pre-open hook at 1676160209408Writing region info on filesystem at 1676160209408Initializing all the Stores at 1676160209409 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209409Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209409Cleaning up temporary data from old regions at 1676160209426 (+17 ms)Cleaning up detritus from prior splits at 1676160209427 (+1 ms)Running coprocessor post-open hooks at 1676160209433 (+6 ms)Region opened successfully at 1676160209433 2023-02-12 00:03:29,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9., pid=23, masterSystemTime=1676160209338 2023-02-12 00:03:29,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:29,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e64fb799d292322bdadaa323edd87f74, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 00:03:29,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:29,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:29,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:29,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1e1dfc1b1d3b6956b57ea012d19919a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 55d66e74d9e7592b55b82b07566fa7a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 00:03:29,438 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209437"}]},"ts":"1676160209437"} 2023-02-12 00:03:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-12 00:03:29,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure a401afb0c77ad416e6b25e0324e1a35c, server=jenkins-hbase9.apache.org,41655,1676160207345 in 244 msec 2023-02-12 00:03:29,441 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, ASSIGN in 415 msec 2023-02-12 00:03:29,441 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-12 00:03:29,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 1e1dfc1b1d3b6956b57ea012d19919a9, server=jenkins-hbase9.apache.org,41835,1676160207374 in 252 msec 2023-02-12 00:03:29,442 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1 2023-02-12 00:03:29,442 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1 2023-02-12 00:03:29,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, ASSIGN in 416 msec 2023-02-12 00:03:29,443 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64fb799d292322bdadaa323edd87f74 columnFamilyName f1 2023-02-12 00:03:29,443 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1 2023-02-12 00:03:29,443 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1 2023-02-12 00:03:29,443 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55d66e74d9e7592b55b82b07566fa7a3 columnFamilyName f1 2023-02-12 00:03:29,443 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(310): Store=e64fb799d292322bdadaa323edd87f74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,443 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,444 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(310): Store=55d66e74d9e7592b55b82b07566fa7a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,444 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,444 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2 2023-02-12 00:03:29,445 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2 2023-02-12 00:03:29,445 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64fb799d292322bdadaa323edd87f74 columnFamilyName f2 2023-02-12 00:03:29,445 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2 2023-02-12 00:03:29,445 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2 2023-02-12 00:03:29,445 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55d66e74d9e7592b55b82b07566fa7a3 columnFamilyName f2 2023-02-12 00:03:29,445 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(310): Store=e64fb799d292322bdadaa323edd87f74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,446 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(310): Store=55d66e74d9e7592b55b82b07566fa7a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:29,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:29,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:29,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:29,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e64fb799d292322bdadaa323edd87f74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66596711, jitterRate=-0.007631674408912659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e64fb799d292322bdadaa323edd87f74: Running coprocessor pre-open hook at 1676160209436Writing region info on filesystem at 1676160209436Initializing all the Stores at 1676160209437 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209438 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209441 (+3 ms)Cleaning up temporary data from old regions at 1676160209447 (+6 ms)Cleaning up detritus from prior splits at 1676160209448 (+1 ms)Running coprocessor post-open hooks at 1676160209452 (+4 ms)Region opened successfully at 1676160209452 2023-02-12 00:03:29,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74., pid=28, masterSystemTime=1676160209343 2023-02-12 00:03:29,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:29,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:29,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e64fb799d292322bdadaa323edd87f74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209455"}]},"ts":"1676160209455"} 2023-02-12 00:03:29,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:29,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 55d66e74d9e7592b55b82b07566fa7a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73949222, jitterRate=0.10192927718162537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:29,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 55d66e74d9e7592b55b82b07566fa7a3: Running coprocessor pre-open hook at 1676160209438Writing region info on filesystem at 1676160209439 (+1 ms)Initializing all the Stores at 1676160209440 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209440Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160209441 (+1 ms)Cleaning up temporary data from old regions at 1676160209448 (+7 ms)Cleaning up detritus from prior splits at 1676160209449 (+1 ms)Running coprocessor post-open hooks at 1676160209456 (+7 ms)Region opened successfully at 1676160209456 2023-02-12 00:03:29,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3., pid=24, masterSystemTime=1676160209338 2023-02-12 00:03:29,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:29,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:29,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-12 00:03:29,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure e64fb799d292322bdadaa323edd87f74, server=jenkins-hbase9.apache.org,41655,1676160207345 in 263 msec 2023-02-12 00:03:29,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=55d66e74d9e7592b55b82b07566fa7a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160209458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160209458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160209458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160209458"}]},"ts":"1676160209458"} 2023-02-12 00:03:29,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, ASSIGN in 433 msec 2023-02-12 00:03:29,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-12 00:03:29,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 55d66e74d9e7592b55b82b07566fa7a3, server=jenkins-hbase9.apache.org,41835,1676160207374 in 272 msec 2023-02-12 00:03:29,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-12 00:03:29,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, ASSIGN in 436 msec 2023-02-12 00:03:29,463 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:29,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160209463"}]},"ts":"1676160209463"} 2023-02-12 00:03:29,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-12 00:03:29,468 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:29,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 954 msec 2023-02-12 00:03:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:29,623 INFO [Listener at localhost/38793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-12 00:03:29,623 DEBUG [Listener at localhost/38793] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-12 00:03:29,623 INFO [Listener at localhost/38793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:29,625 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-12 00:03:29,626 INFO [Listener at localhost/38793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:29,626 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-12 00:03:29,626 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:29,663 DEBUG [hconnection-0x2fa3ce60-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:29,676 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:29,676 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41655] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,684 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:29,780 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:29,780 INFO [Listener at localhost/38793] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:29,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 00:03:29,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160209781 (current time:1676160209781). 2023-02-12 00:03:29,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:29,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] zookeeper.ReadOnlyZKClient(139): Connect 0x67137202 to 127.0.0.1:52767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:29,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aa5958f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:29,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:29,790 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67137202 to 127.0.0.1:52767 2023-02-12 00:03:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:29,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:29,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 00:03:29,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 00:03:29,796 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 00:03:29,796 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676160809796 2023-02-12 00:03:29,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 00:03:29,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,798 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:29,798 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 00:03:29,798 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:29,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 00:03:29,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-12 00:03:29,800 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 00:03:29,801 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676160809801 2023-02-12 00:03:29,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,818 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 00:03:29,818 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:29,819 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 00:03:29,819 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 00:03:29,820 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,820 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,821 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:29,821 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:29,821 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:29,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:29,822 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,822 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,822 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,822 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 00:03:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,823 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 00:03:29,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 00:03:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,823 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 00:03:29,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,824 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 00:03:29,824 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41655,1676160207345' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 00:03:29,826 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41835,1676160207374' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,830 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,830 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,830 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41835,1676160207374' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1707c3bc[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:29,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41655,1676160207345' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 00:03:29,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1707c3bc[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:29,834 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 00:03:29,834 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,836 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:29,836 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:29,836 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:29,836 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,836 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:29,836 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:29,836 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:29,836 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. started... 2023-02-12 00:03:29,836 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. started... 2023-02-12 00:03:29,839 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a401afb0c77ad416e6b25e0324e1a35c: 2023-02-12 00:03:29,839 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 964327a1b0f6ad05f91a89d74776ec07: 2023-02-12 00:03:29,840 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,840 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,840 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,840 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,841 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:29,841 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. started... 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. started... 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. started... 2023-02-12 00:03:29,841 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 00:03:29,842 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:29,842 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7c164096fdc52b41c29486a367210d62 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:29,842 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f31a13eccfd65e5fe1df5ad209ac0da0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 00:03:29,842 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 55d66e74d9e7592b55b82b07566fa7a3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,841 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. started... 2023-02-12 00:03:29,842 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 00:03:29,844 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1fb5c28e2c7acbd3022b4552c4e1f78e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,875 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. completed. 2023-02-12 00:03:29,875 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:29,875 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:29,875 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:29,875 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. started... 2023-02-12 00:03:29,880 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cfeb4ce153992da2963d9666d37081bc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,891 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f1/43c3253bfe8a465c950ad4c60d5db0e8 2023-02-12 00:03:29,891 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. completed. 2023-02-12 00:03:29,892 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:29,892 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:29,892 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 00:03:29,892 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f1/cf5fc316ee654a6f9b5087d3b063e871 2023-02-12 00:03:29,892 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. started... 2023-02-12 00:03:29,893 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b87a34a4b86d36c38b4d76281c22acbf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,897 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f1/ccd8576a62c44cbaaac2a2600ce26478 2023-02-12 00:03:29,897 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f1/7d3b1efd889b42cdb18f7e9d17427c0f 2023-02-12 00:03:29,899 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:29,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:29,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:29,900 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:29,919 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f1/269c1e01c74b4ba1ada77f5514ca31be 2023-02-12 00:03:29,939 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f2/554bc1c9f2d94cb7b47f44f730b94f10 2023-02-12 00:03:29,939 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f2/a9c47429f7814c84bd51a6a34bcbb4db 2023-02-12 00:03:29,942 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f2/49dc9a371cc544ce9fc526a472efa4fa 2023-02-12 00:03:29,948 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f1/43c3253bfe8a465c950ad4c60d5db0e8 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8 2023-02-12 00:03:29,949 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f1/7d3b1efd889b42cdb18f7e9d17427c0f as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f 2023-02-12 00:03:29,950 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f1/cf5fc316ee654a6f9b5087d3b063e871 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871 2023-02-12 00:03:29,953 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,954 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:29,954 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f2/554bc1c9f2d94cb7b47f44f730b94f10 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10 2023-02-12 00:03:29,954 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f2/219eccb0f6494ac2b3f6a523995dcf58 2023-02-12 00:03:29,955 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,955 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f2/49dc9a371cc544ce9fc526a472efa4fa as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa 2023-02-12 00:03:29,956 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f2/a9c47429f7814c84bd51a6a34bcbb4db as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db 2023-02-12 00:03:29,960 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,960 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f1/ccd8576a62c44cbaaac2a2600ce26478 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478 2023-02-12 00:03:29,961 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 55d66e74d9e7592b55b82b07566fa7a3 in 119ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:29,961 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-12 00:03:29,962 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 55d66e74d9e7592b55b82b07566fa7a3: 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8] hfiles 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10] hfiles 2023-02-12 00:03:29,962 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,962 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7c164096fdc52b41c29486a367210d62 in 120ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:29,966 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f2/68631578ede445df881fd06d0d5e1882 2023-02-12 00:03:29,967 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7c164096fdc52b41c29486a367210d62: 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f] hfiles 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa] hfiles 2023-02-12 00:03:29,968 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,970 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:29,970 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,970 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f2/219eccb0f6494ac2b3f6a523995dcf58 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58 2023-02-12 00:03:29,971 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1fb5c28e2c7acbd3022b4552c4e1f78e in 127ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871] hfiles 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db] hfiles 2023-02-12 00:03:29,971 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,975 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. completed. 2023-02-12 00:03:29,975 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:29,975 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:29,975 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:29,975 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. started... 2023-02-12 00:03:29,975 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f1/269c1e01c74b4ba1ada77f5514ca31be as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be 2023-02-12 00:03:29,977 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 00:03:29,978 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f31a13eccfd65e5fe1df5ad209ac0da0 in 136ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:29,978 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f31a13eccfd65e5fe1df5ad209ac0da0: 2023-02-12 00:03:29,978 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,978 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,979 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478] hfiles 2023-02-12 00:03:29,979 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,979 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58] hfiles 2023-02-12 00:03:29,980 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1e1dfc1b1d3b6956b57ea012d19919a9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,980 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,980 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. completed. 2023-02-12 00:03:29,980 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:29,980 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:29,983 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,984 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f2/68631578ede445df881fd06d0d5e1882 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882 2023-02-12 00:03:29,986 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. completed. 2023-02-12 00:03:29,986 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:29,986 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:29,986 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 00:03:29,986 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. started... 2023-02-12 00:03:29,987 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e64fb799d292322bdadaa323edd87f74 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 00:03:29,993 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:29,994 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cfeb4ce153992da2963d9666d37081bc in 114ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cfeb4ce153992da2963d9666d37081bc: 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be] hfiles 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882] hfiles 2023-02-12 00:03:29,994 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:29,999 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f1/8af20ddfd2b64d87a77676b8265fb682 2023-02-12 00:03:29,999 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. completed. 2023-02-12 00:03:29,999 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:29,999 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 00:03:30,005 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. completed. 2023-02-12 00:03:30,005 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:30,005 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:30,009 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f1/079bf01e87624de6b7e836c868f76826 2023-02-12 00:03:30,012 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f2/3c6f3a6c65a24516a9fa96da86606f46 2023-02-12 00:03:30,016 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f1/8af20ddfd2b64d87a77676b8265fb682 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682 2023-02-12 00:03:30,020 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,021 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f2/3c6f3a6c65a24516a9fa96da86606f46 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46 2023-02-12 00:03:30,023 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f2/b85ac8a4aabe407a88a8a9851652ccb6 2023-02-12 00:03:30,026 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,026 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1e1dfc1b1d3b6956b57ea012d19919a9 in 46ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1e1dfc1b1d3b6956b57ea012d19919a9: 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682] hfiles 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46] hfiles 2023-02-12 00:03:30,027 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,028 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f1/079bf01e87624de6b7e836c868f76826 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826 2023-02-12 00:03:30,032 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,033 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f2/b85ac8a4aabe407a88a8a9851652ccb6 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6 2023-02-12 00:03:30,037 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,038 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e64fb799d292322bdadaa323edd87f74 in 51ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:30,038 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e64fb799d292322bdadaa323edd87f74: 2023-02-12 00:03:30,038 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,038 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:30,038 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826] hfiles 2023-02-12 00:03:30,038 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,039 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6] hfiles 2023-02-12 00:03:30,039 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,043 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. completed. 2023-02-12 00:03:30,043 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:30,043 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 00:03:30,046 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. completed. 2023-02-12 00:03:30,046 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:30,046 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:30,046 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:30,046 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,046 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 00:03:30,046 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,41655,1676160207345' in zk 2023-02-12 00:03:30,048 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:30,048 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,048 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:30,048 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 00:03:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,41655,1676160207345': 2023-02-12 00:03:30,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41655,1676160207345' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 00:03:30,100 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:30,102 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 00:03:30,320 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f1/b4e877bc315640968307c77bb3e02e14 2023-02-12 00:03:30,335 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f2/1d8af75da6244b5b936af13f7be33b7d 2023-02-12 00:03:30,345 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f1/b4e877bc315640968307c77bb3e02e14 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14 2023-02-12 00:03:30,349 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,349 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f2/1d8af75da6244b5b936af13f7be33b7d as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d 2023-02-12 00:03:30,354 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 00:03:30,355 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b87a34a4b86d36c38b4d76281c22acbf in 462ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b87a34a4b86d36c38b4d76281c22acbf: 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14] hfiles 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d] hfiles 2023-02-12 00:03:30,355 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,363 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. completed. 2023-02-12 00:03:30,363 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:30,363 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 00:03:30,363 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 00:03:30,363 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,363 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 00:03:30,363 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,41835,1676160207374' in zk 2023-02-12 00:03:30,365 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:30,365 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,365 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:30,365 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 00:03:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,41835,1676160207374': 2023-02-12 00:03:30,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41835,1676160207374' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:30,369 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 00:03:30,369 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:30,369 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:30,369 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,369 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:30,372 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,372 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,372 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,372 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:30,373 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:30,373 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,375 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:30,375 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:30,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:30,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:30,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:30,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,402 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:30,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:30,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:30,404 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 00:03:30,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-12 00:03:30,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,442 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:30,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676160209796Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676160210381 (+585 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676160210381Writing data manifest for testWithMockedMapReduceMultiRegion at 1676160210395 (+14 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676160210404 (+9 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676160210442 (+38 ms) 2023-02-12 00:03:30,444 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 00:03:30,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 647 msec 2023-02-12 00:03:30,905 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:30,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:30,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:30,906 INFO [Listener at localhost/38793] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:30,910 INFO [Listener at localhost/38793] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:30,916 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:30,940 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41655] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:30,942 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:30,991 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:30,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:31,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,000 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 00:03:31,000 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:31,001 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 00:03:31,001 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 00:03:31,002 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,002 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,003 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:31,003 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:31,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:31,003 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,004 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,004 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,011 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 00:03:31,011 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:31,011 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:31,011 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 00:03:31,011 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:31,012 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,012 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 00:03:31,012 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:31,012 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. started... 2023-02-12 00:03:31,012 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,013 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:31,013 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 00:03:31,013 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. started... 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 964327a1b0f6ad05f91a89d74776ec07: 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. started... 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,013 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 55d66e74d9e7592b55b82b07566fa7a3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,013 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7c164096fdc52b41c29486a367210d62 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. started... 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. started... 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a401afb0c77ad416e6b25e0324e1a35c: 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,013 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f31a13eccfd65e5fe1df5ad209ac0da0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 00:03:31,013 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. started... 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,014 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. started... 2023-02-12 00:03:31,014 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cfeb4ce153992da2963d9666d37081bc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,013 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 00:03:31,013 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,014 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. started... 2023-02-12 00:03:31,014 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1fb5c28e2c7acbd3022b4552c4e1f78e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,015 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b87a34a4b86d36c38b4d76281c22acbf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,054 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f1/eaaf5b8f02574269a4feb8bb46a25e2b 2023-02-12 00:03:31,067 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f1/b5da4bf5c2f24542a4b222c16dbbbb85 2023-02-12 00:03:31,076 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f1/95a83f0619514735896594603a3f1302 2023-02-12 00:03:31,078 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f1/f609b6aa020d46cdafaaf5b1a2150b55 2023-02-12 00:03:31,097 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f1/c6b442bea5724841a2e5b5f055abf11b 2023-02-12 00:03:31,097 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f1/792a3d5494e4479a80ac64958d0cb323 2023-02-12 00:03:31,097 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f2/2a9888bd28e94edfbf48376a98421fc8 2023-02-12 00:03:31,116 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f2/458878506c3545c28d2b813468de1e9c 2023-02-12 00:03:31,118 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f2/b9a80c9615f749c8be7e4430b3a1f958 2023-02-12 00:03:31,120 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f1/eaaf5b8f02574269a4feb8bb46a25e2b as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/eaaf5b8f02574269a4feb8bb46a25e2b 2023-02-12 00:03:31,123 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f1/b5da4bf5c2f24542a4b222c16dbbbb85 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/b5da4bf5c2f24542a4b222c16dbbbb85 2023-02-12 00:03:31,125 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f1/95a83f0619514735896594603a3f1302 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/95a83f0619514735896594603a3f1302 2023-02-12 00:03:31,125 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/eaaf5b8f02574269a4feb8bb46a25e2b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,126 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/.tmp/f2/2a9888bd28e94edfbf48376a98421fc8 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/2a9888bd28e94edfbf48376a98421fc8 2023-02-12 00:03:31,127 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f2/3e8fc20a791c4cfba4ca14dba70e777f 2023-02-12 00:03:31,132 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/95a83f0619514735896594603a3f1302, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,134 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/b5da4bf5c2f24542a4b222c16dbbbb85, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:31,134 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/.tmp/f2/b9a80c9615f749c8be7e4430b3a1f958 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/b9a80c9615f749c8be7e4430b3a1f958 2023-02-12 00:03:31,134 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/2a9888bd28e94edfbf48376a98421fc8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,134 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f1/f609b6aa020d46cdafaaf5b1a2150b55 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/f609b6aa020d46cdafaaf5b1a2150b55 2023-02-12 00:03:31,135 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f2/f16dc7df14f14e8d9a762019357e2427 2023-02-12 00:03:31,138 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/b9a80c9615f749c8be7e4430b3a1f958, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,139 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cfeb4ce153992da2963d9666d37081bc in 125ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,139 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cfeb4ce153992da2963d9666d37081bc: 2023-02-12 00:03:31,139 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,139 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,139 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. started... 2023-02-12 00:03:31,139 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:31,139 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e64fb799d292322bdadaa323edd87f74 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,140 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/.tmp/f2/458878506c3545c28d2b813468de1e9c as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/458878506c3545c28d2b813468de1e9c 2023-02-12 00:03:31,140 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1fb5c28e2c7acbd3022b4552c4e1f78e in 126ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,140 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: 2023-02-12 00:03:31,140 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,140 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:31,144 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5 2023-02-12 00:03:31,144 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/f609b6aa020d46cdafaaf5b1a2150b55, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:31,146 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/.tmp/f2/3e8fc20a791c4cfba4ca14dba70e777f as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/3e8fc20a791c4cfba4ca14dba70e777f 2023-02-12 00:03:31,147 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f1/c6b442bea5724841a2e5b5f055abf11b as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/c6b442bea5724841a2e5b5f055abf11b 2023-02-12 00:03:31,149 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/458878506c3545c28d2b813468de1e9c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:31,149 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7c164096fdc52b41c29486a367210d62 in 136ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,150 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7c164096fdc52b41c29486a367210d62: 2023-02-12 00:03:31,150 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,150 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,150 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. started... 2023-02-12 00:03:31,150 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1e1dfc1b1d3b6956b57ea012d19919a9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 00:03:31,150 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 00:03:31,151 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f1/792a3d5494e4479a80ac64958d0cb323 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/792a3d5494e4479a80ac64958d0cb323 2023-02-12 00:03:31,161 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/3e8fc20a791c4cfba4ca14dba70e777f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 00:03:31,161 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/c6b442bea5724841a2e5b5f055abf11b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,161 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f31a13eccfd65e5fe1df5ad209ac0da0 in 148ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,161 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f31a13eccfd65e5fe1df5ad209ac0da0: 2023-02-12 00:03:31,161 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,162 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:31,163 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/.tmp/f2/f16dc7df14f14e8d9a762019357e2427 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/f16dc7df14f14e8d9a762019357e2427 2023-02-12 00:03:31,164 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/792a3d5494e4479a80ac64958d0cb323, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,165 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/.tmp/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5 2023-02-12 00:03:31,173 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/f16dc7df14f14e8d9a762019357e2427, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,174 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 55d66e74d9e7592b55b82b07566fa7a3 in 161ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,174 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 55d66e74d9e7592b55b82b07566fa7a3: 2023-02-12 00:03:31,174 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,174 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 00:03:31,179 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f1/83ec2da7897944adb160c6e8f0f97277 2023-02-12 00:03:31,181 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,182 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b87a34a4b86d36c38b4d76281c22acbf in 167ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,182 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b87a34a4b86d36c38b4d76281c22acbf: 2023-02-12 00:03:31,182 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,182 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 00:03:31,190 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f1/041ed6707ea446a792fb58d98ae6466d 2023-02-12 00:03:31,201 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f2/a77a790867904e888577d95b7a8d4973 2023-02-12 00:03:31,204 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f2/6521c435a4af4d06a3d418bc2657d937 2023-02-12 00:03:31,206 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f1/83ec2da7897944adb160c6e8f0f97277 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/83ec2da7897944adb160c6e8f0f97277 2023-02-12 00:03:31,209 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f1/041ed6707ea446a792fb58d98ae6466d as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/041ed6707ea446a792fb58d98ae6466d 2023-02-12 00:03:31,212 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/83ec2da7897944adb160c6e8f0f97277, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,212 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/.tmp/f2/a77a790867904e888577d95b7a8d4973 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/a77a790867904e888577d95b7a8d4973 2023-02-12 00:03:31,214 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/041ed6707ea446a792fb58d98ae6466d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,215 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/.tmp/f2/6521c435a4af4d06a3d418bc2657d937 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/6521c435a4af4d06a3d418bc2657d937 2023-02-12 00:03:31,223 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/6521c435a4af4d06a3d418bc2657d937, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,223 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/a77a790867904e888577d95b7a8d4973, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 00:03:31,223 INFO [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1e1dfc1b1d3b6956b57ea012d19919a9 in 73ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,224 INFO [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e64fb799d292322bdadaa323edd87f74 in 84ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:31,224 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1e1dfc1b1d3b6956b57ea012d19919a9: 2023-02-12 00:03:31,224 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e64fb799d292322bdadaa323edd87f74: 2023-02-12 00:03:31,224 DEBUG [rs(jenkins-hbase9.apache.org,41835,1676160207374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,224 DEBUG [rs(jenkins-hbase9.apache.org,41655,1676160207345)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41655,1676160207345' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 00:03:31,224 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41835,1676160207374' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 00:03:31,226 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,226 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:31,226 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,226 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,226 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:31,226 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:31,227 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,227 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41655,1676160207345' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13384584[Count = 1] remaining members to acquire global barrier 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41835,1676160207374' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13384584[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:31,230 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 00:03:31,230 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,41655,1676160207345' in zk 2023-02-12 00:03:31,232 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,41835,1676160207374' in zk 2023-02-12 00:03:31,232 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,232 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:31,234 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:31,234 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41835,1676160207374' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:31,234 DEBUG [member: 'jenkins-hbase9.apache.org,41655,1676160207345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,41655,1676160207345': 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41655,1676160207345' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,41835,1676160207374': 2023-02-12 00:03:31,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41835,1676160207374' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:31,239 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 00:03:31,239 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:31,239 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:31,239 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,239 INFO [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:31,240 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,240 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,240 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,240 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:31,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:31,240 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:31,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:31,241 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:31,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:31,241 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,242 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,243 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:31,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:31,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:31,245 DEBUG [(jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:31,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-12 00:03:31,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:31,245 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:31,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,246 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,346 DEBUG [Listener at localhost/38793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:31,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:31,352 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676160209781 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:31,353 DEBUG [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:31,353 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(239): region to add: cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=964327a1b0f6ad05f91a89d74776ec07 as 964327a1b0f6ad05f91a89d74776ec07 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=7c164096fdc52b41c29486a367210d62 as 7c164096fdc52b41c29486a367210d62 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=a401afb0c77ad416e6b25e0324e1a35c as a401afb0c77ad416e6b25e0324e1a35c in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=55d66e74d9e7592b55b82b07566fa7a3 as 55d66e74d9e7592b55b82b07566fa7a3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=1fb5c28e2c7acbd3022b4552c4e1f78e as 1fb5c28e2c7acbd3022b4552c4e1f78e in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=b87a34a4b86d36c38b4d76281c22acbf as b87a34a4b86d36c38b4d76281c22acbf in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=1e1dfc1b1d3b6956b57ea012d19919a9 as 1e1dfc1b1d3b6956b57ea012d19919a9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=f31a13eccfd65e5fe1df5ad209ac0da0 as f31a13eccfd65e5fe1df5ad209ac0da0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,354 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=e64fb799d292322bdadaa323edd87f74 as e64fb799d292322bdadaa323edd87f74 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,355 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(585): clone region=cfeb4ce153992da2963d9666d37081bc as cfeb4ce153992da2963d9666d37081bc in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,355 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 964327a1b0f6ad05f91a89d74776ec07, NAME => 'testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,356 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 55d66e74d9e7592b55b82b07566fa7a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,356 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1e1dfc1b1d3b6956b57ea012d19919a9, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,356 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => f31a13eccfd65e5fe1df5ad209ac0da0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,357 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1fb5c28e2c7acbd3022b4552c4e1f78e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,357 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7c164096fdc52b41c29486a367210d62, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,357 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a401afb0c77ad416e6b25e0324e1a35c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,358 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => b87a34a4b86d36c38b4d76281c22acbf, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,403 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,403 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a401afb0c77ad416e6b25e0324e1a35c, disabling compactions & flushes 2023-02-12 00:03:31,403 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. after waiting 0 ms 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,404 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 964327a1b0f6ad05f91a89d74776ec07, disabling compactions & flushes 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a401afb0c77ad416e6b25e0324e1a35c: Waiting for close lock at 1676160211403Disabling compacts and flushes for region at 1676160211403Disabling writes for close at 1676160211404 (+1 ms)Writing region close event to WAL at 1676160211404Closed at 1676160211404 2023-02-12 00:03:31,404 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,404 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e64fb799d292322bdadaa323edd87f74, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,404 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. after waiting 0 ms 2023-02-12 00:03:31,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,405 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:31,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 964327a1b0f6ad05f91a89d74776ec07: Waiting for close lock at 1676160211404Disabling compacts and flushes for region at 1676160211404Disabling writes for close at 1676160211405 (+1 ms)Writing region close event to WAL at 1676160211405Closed at 1676160211405 2023-02-12 00:03:31,405 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cfeb4ce153992da2963d9666d37081bc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,407 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,407 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cf5fc316ee654a6f9b5087d3b063e871 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,409 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,409 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8af20ddfd2b64d87a77676b8265fb682 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,413 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,413 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7d3b1efd889b42cdb18f7e9d17427c0f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,414 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9c47429f7814c84bd51a6a34bcbb4db from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,423 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,423 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 079bf01e87624de6b7e836c868f76826 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,423 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,423 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c6f3a6c65a24516a9fa96da86606f46 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,424 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 43c3253bfe8a465c950ad4c60d5db0e8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,427 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,427 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b4e877bc315640968307c77bb3e02e14 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,434 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 554bc1c9f2d94cb7b47f44f730b94f10 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1fb5c28e2c7acbd3022b4552c4e1f78e, disabling compactions & flushes 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1e1dfc1b1d3b6956b57ea012d19919a9, disabling compactions & flushes 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49dc9a371cc544ce9fc526a472efa4fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. after waiting 0 ms 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b85ac8a4aabe407a88a8a9851652ccb6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Waiting for close lock at 1676160211435Disabling compacts and flushes for region at 1676160211435Disabling writes for close at 1676160211435Writing region close event to WAL at 1676160211435Closed at 1676160211435 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. after waiting 0 ms 2023-02-12 00:03:31,435 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1d8af75da6244b5b936af13f7be33b7d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,435 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:31,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Waiting for close lock at 1676160211435Disabling compacts and flushes for region at 1676160211435Disabling writes for close at 1676160211435Writing region close event to WAL at 1676160211435Closed at 1676160211435 2023-02-12 00:03:31,439 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing b87a34a4b86d36c38b4d76281c22acbf, disabling compactions & flushes 2023-02-12 00:03:31,439 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,439 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 55d66e74d9e7592b55b82b07566fa7a3, disabling compactions & flushes 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 269c1e01c74b4ba1ada77f5514ca31be from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,439 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. after waiting 0 ms 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e64fb799d292322bdadaa323edd87f74, disabling compactions & flushes 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. after waiting 0 ms 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7c164096fdc52b41c29486a367210d62, disabling compactions & flushes 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. after waiting 0 ms 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e64fb799d292322bdadaa323edd87f74: Waiting for close lock at 1676160211440Disabling compacts and flushes for region at 1676160211440Disabling writes for close at 1676160211440Writing region close event to WAL at 1676160211440Closed at 1676160211440 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. after waiting 0 ms 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for b87a34a4b86d36c38b4d76281c22acbf: Waiting for close lock at 1676160211439Disabling compacts and flushes for region at 1676160211439Disabling writes for close at 1676160211440 (+1 ms)Writing region close event to WAL at 1676160211440Closed at 1676160211440 2023-02-12 00:03:31,440 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7c164096fdc52b41c29486a367210d62: Waiting for close lock at 1676160211440Disabling compacts and flushes for region at 1676160211440Disabling writes for close at 1676160211440Writing region close event to WAL at 1676160211440Closed at 1676160211440 2023-02-12 00:03:31,440 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:31,441 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 55d66e74d9e7592b55b82b07566fa7a3: Waiting for close lock at 1676160211439Disabling compacts and flushes for region at 1676160211439Disabling writes for close at 1676160211440 (+1 ms)Writing region close event to WAL at 1676160211440Closed at 1676160211440 2023-02-12 00:03:31,443 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68631578ede445df881fd06d0d5e1882 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,444 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cfeb4ce153992da2963d9666d37081bc, disabling compactions & flushes 2023-02-12 00:03:31,444 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,444 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,444 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. after waiting 0 ms 2023-02-12 00:03:31,445 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,445 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:31,445 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cfeb4ce153992da2963d9666d37081bc: Waiting for close lock at 1676160211444Disabling compacts and flushes for region at 1676160211444Disabling writes for close at 1676160211445 (+1 ms)Writing region close event to WAL at 1676160211445Closed at 1676160211445 2023-02-12 00:03:31,793 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:31,793 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ccd8576a62c44cbaaac2a2600ce26478 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,795 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 219eccb0f6494ac2b3f6a523995dcf58 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:31,796 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing f31a13eccfd65e5fe1df5ad209ac0da0, disabling compactions & flushes 2023-02-12 00:03:31,797 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,797 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,797 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. after waiting 0 ms 2023-02-12 00:03:31,797 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,797 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:31,797 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for f31a13eccfd65e5fe1df5ad209ac0da0: Waiting for close lock at 1676160211796Disabling compacts and flushes for region at 1676160211796Disabling writes for close at 1676160211797 (+1 ms)Writing region close event to WAL at 1676160211797Closed at 1676160211797 2023-02-12 00:03:31,797 INFO [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676160209781 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:31,797 DEBUG [Listener at localhost/38793] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,797 DEBUG [Listener at localhost/38793] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279 2023-02-12 00:03:31,798 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:31,798 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:31,798 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-12 00:03:31,799 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------1e1dfc1b1d3b6956b57ea012d19919a9/ 2023-02-12 00:03:31,799 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,799 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,799 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1e1dfc1b1d3b6956b57ea012d19919a9-8af20ddfd2b64d87a77676b8265fb682 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1e1dfc1b1d3b6956b57ea012d19919a9-3c6f3a6c65a24516a9fa96da86606f46 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------1fb5c28e2c7acbd3022b4552c4e1f78e/ 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1fb5c28e2c7acbd3022b4552c4e1f78e-cf5fc316ee654a6f9b5087d3b063e871 2023-02-12 00:03:31,800 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1fb5c28e2c7acbd3022b4552c4e1f78e-a9c47429f7814c84bd51a6a34bcbb4db 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------55d66e74d9e7592b55b82b07566fa7a3/ 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=55d66e74d9e7592b55b82b07566fa7a3-43c3253bfe8a465c950ad4c60d5db0e8 2023-02-12 00:03:31,801 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=55d66e74d9e7592b55b82b07566fa7a3-554bc1c9f2d94cb7b47f44f730b94f10 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------7c164096fdc52b41c29486a367210d62/ 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7c164096fdc52b41c29486a367210d62-7d3b1efd889b42cdb18f7e9d17427c0f 2023-02-12 00:03:31,802 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7c164096fdc52b41c29486a367210d62-49dc9a371cc544ce9fc526a472efa4fa 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------964327a1b0f6ad05f91a89d74776ec07/ 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------a401afb0c77ad416e6b25e0324e1a35c/ 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,803 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------b87a34a4b86d36c38b4d76281c22acbf/ 2023-02-12 00:03:31,804 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,804 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,804 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b87a34a4b86d36c38b4d76281c22acbf-b4e877bc315640968307c77bb3e02e14 2023-02-12 00:03:31,804 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,804 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b87a34a4b86d36c38b4d76281c22acbf-1d8af75da6244b5b936af13f7be33b7d 2023-02-12 00:03:31,805 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------cfeb4ce153992da2963d9666d37081bc/ 2023-02-12 00:03:31,805 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,805 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,805 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cfeb4ce153992da2963d9666d37081bc-269c1e01c74b4ba1ada77f5514ca31be 2023-02-12 00:03:31,805 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cfeb4ce153992da2963d9666d37081bc-68631578ede445df881fd06d0d5e1882 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------e64fb799d292322bdadaa323edd87f74/ 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e64fb799d292322bdadaa323edd87f74-079bf01e87624de6b7e836c868f76826 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,806 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e64fb799d292322bdadaa323edd87f74-b85ac8a4aabe407a88a8a9851652ccb6 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |----------f31a13eccfd65e5fe1df5ad209ac0da0/ 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f31a13eccfd65e5fe1df5ad209ac0da0-ccd8576a62c44cbaaac2a2600ce26478 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:31,807 DEBUG [Listener at localhost/38793] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f31a13eccfd65e5fe1df5ad209ac0da0-219eccb0f6494ac2b3f6a523995dcf58 2023-02-12 00:03:31,810 INFO [Listener at localhost/38793] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 00:03:32,447 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,448 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,449 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,451 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:32,452 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1 2023-02-12 00:03:32,452 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e1dfc1b1d3b6956b57ea012d19919a9 columnFamilyName f1 2023-02-12 00:03:32,456 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/testWithMockedMapReduceMultiRegion=1e1dfc1b1d3b6956b57ea012d19919a9-8af20ddfd2b64d87a77676b8265fb682 2023-02-12 00:03:32,456 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(310): Store=1e1dfc1b1d3b6956b57ea012d19919a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,456 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:32,457 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2 2023-02-12 00:03:32,457 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e1dfc1b1d3b6956b57ea012d19919a9 columnFamilyName f2 2023-02-12 00:03:32,460 DEBUG [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/testWithMockedMapReduceMultiRegion=1e1dfc1b1d3b6956b57ea012d19919a9-3c6f3a6c65a24516a9fa96da86606f46 2023-02-12 00:03:32,460 INFO [StoreOpener-1e1dfc1b1d3b6956b57ea012d19919a9-1] regionserver.HStore(310): Store=1e1dfc1b1d3b6956b57ea012d19919a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,460 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,461 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened 1e1dfc1b1d3b6956b57ea012d19919a9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72011118, jitterRate=0.07304927706718445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,461 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Writing region info on filesystem at 1676160212449Initializing all the Stores at 1676160212450 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212450Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212450Region opened successfully at 1676160212461 (+11 ms) 2023-02-12 00:03:32,468 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing 1e1dfc1b1d3b6956b57ea012d19919a9, disabling compactions & flushes 2023-02-12 00:03:32,469 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,469 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,469 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. after waiting 0 ms 2023-02-12 00:03:32,469 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,469 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,469 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Waiting for close lock at 1676160212468Disabling compacts and flushes for region at 1676160212468Disabling writes for close at 1676160212469 (+1 ms)Writing region close event to WAL at 1676160212469Closed at 1676160212469 2023-02-12 00:03:32,470 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,470 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,475 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,476 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:32,477 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f1 2023-02-12 00:03:32,478 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964327a1b0f6ad05f91a89d74776ec07 columnFamilyName f1 2023-02-12 00:03:32,478 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(310): Store=964327a1b0f6ad05f91a89d74776ec07/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,478 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:32,479 DEBUG [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f2 2023-02-12 00:03:32,479 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964327a1b0f6ad05f91a89d74776ec07 columnFamilyName f2 2023-02-12 00:03:32,480 INFO [StoreOpener-964327a1b0f6ad05f91a89d74776ec07-1] regionserver.HStore(310): Store=964327a1b0f6ad05f91a89d74776ec07/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,480 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened 964327a1b0f6ad05f91a89d74776ec07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69030771, jitterRate=0.028638646006584167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for 964327a1b0f6ad05f91a89d74776ec07: Writing region info on filesystem at 1676160212475Initializing all the Stores at 1676160212475Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212475Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212475Region opened successfully at 1676160212480 (+5 ms) 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing 964327a1b0f6ad05f91a89d74776ec07, disabling compactions & flushes 2023-02-12 00:03:32,480 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. after waiting 0 ms 2023-02-12 00:03:32,480 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,481 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,481 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for 964327a1b0f6ad05f91a89d74776ec07: Waiting for close lock at 1676160212480Disabling compacts and flushes for region at 1676160212480Disabling writes for close at 1676160212480Writing region close event to WAL at 1676160212481 (+1 ms)Closed at 1676160212481 2023-02-12 00:03:32,481 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,481 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,483 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,487 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:32,488 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f1 2023-02-12 00:03:32,488 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a401afb0c77ad416e6b25e0324e1a35c columnFamilyName f1 2023-02-12 00:03:32,488 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(310): Store=a401afb0c77ad416e6b25e0324e1a35c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,488 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:32,489 DEBUG [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f2 2023-02-12 00:03:32,489 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a401afb0c77ad416e6b25e0324e1a35c columnFamilyName f2 2023-02-12 00:03:32,490 INFO [StoreOpener-a401afb0c77ad416e6b25e0324e1a35c-1] regionserver.HStore(310): Store=a401afb0c77ad416e6b25e0324e1a35c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,490 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened a401afb0c77ad416e6b25e0324e1a35c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69667939, jitterRate=0.03813318908214569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for a401afb0c77ad416e6b25e0324e1a35c: Writing region info on filesystem at 1676160212483Initializing all the Stores at 1676160212483Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212483Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212486 (+3 ms)Region opened successfully at 1676160212490 (+4 ms) 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing a401afb0c77ad416e6b25e0324e1a35c, disabling compactions & flushes 2023-02-12 00:03:32,490 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. after waiting 0 ms 2023-02-12 00:03:32,490 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,491 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,491 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for a401afb0c77ad416e6b25e0324e1a35c: Waiting for close lock at 1676160212490Disabling compacts and flushes for region at 1676160212490Disabling writes for close at 1676160212490Writing region close event to WAL at 1676160212491 (+1 ms)Closed at 1676160212491 2023-02-12 00:03:32,491 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,491 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,494 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,496 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:32,496 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1 2023-02-12 00:03:32,497 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c164096fdc52b41c29486a367210d62 columnFamilyName f1 2023-02-12 00:03:32,500 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/testWithMockedMapReduceMultiRegion=7c164096fdc52b41c29486a367210d62-7d3b1efd889b42cdb18f7e9d17427c0f 2023-02-12 00:03:32,500 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(310): Store=7c164096fdc52b41c29486a367210d62/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,500 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:32,501 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2 2023-02-12 00:03:32,501 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c164096fdc52b41c29486a367210d62 columnFamilyName f2 2023-02-12 00:03:32,505 DEBUG [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/testWithMockedMapReduceMultiRegion=7c164096fdc52b41c29486a367210d62-49dc9a371cc544ce9fc526a472efa4fa 2023-02-12 00:03:32,505 INFO [StoreOpener-7c164096fdc52b41c29486a367210d62-1] regionserver.HStore(310): Store=7c164096fdc52b41c29486a367210d62/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,506 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,506 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened 7c164096fdc52b41c29486a367210d62; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74045150, jitterRate=0.10335871577262878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,506 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for 7c164096fdc52b41c29486a367210d62: Writing region info on filesystem at 1676160212494Initializing all the Stores at 1676160212495 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212495Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212495Region opened successfully at 1676160212506 (+11 ms) 2023-02-12 00:03:32,515 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing 7c164096fdc52b41c29486a367210d62, disabling compactions & flushes 2023-02-12 00:03:32,515 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,515 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,515 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. after waiting 0 ms 2023-02-12 00:03:32,515 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,516 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,516 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for 7c164096fdc52b41c29486a367210d62: Waiting for close lock at 1676160212515Disabling compacts and flushes for region at 1676160212515Disabling writes for close at 1676160212515Writing region close event to WAL at 1676160212516 (+1 ms)Closed at 1676160212516 2023-02-12 00:03:32,516 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,516 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,517 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,519 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:32,520 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1 2023-02-12 00:03:32,520 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55d66e74d9e7592b55b82b07566fa7a3 columnFamilyName f1 2023-02-12 00:03:32,523 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/testWithMockedMapReduceMultiRegion=55d66e74d9e7592b55b82b07566fa7a3-43c3253bfe8a465c950ad4c60d5db0e8 2023-02-12 00:03:32,523 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(310): Store=55d66e74d9e7592b55b82b07566fa7a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,523 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:32,524 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2 2023-02-12 00:03:32,524 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55d66e74d9e7592b55b82b07566fa7a3 columnFamilyName f2 2023-02-12 00:03:32,527 DEBUG [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/testWithMockedMapReduceMultiRegion=55d66e74d9e7592b55b82b07566fa7a3-554bc1c9f2d94cb7b47f44f730b94f10 2023-02-12 00:03:32,527 INFO [StoreOpener-55d66e74d9e7592b55b82b07566fa7a3-1] regionserver.HStore(310): Store=55d66e74d9e7592b55b82b07566fa7a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,527 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,527 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened 55d66e74d9e7592b55b82b07566fa7a3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59169605, jitterRate=-0.11830417811870575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,528 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for 55d66e74d9e7592b55b82b07566fa7a3: Writing region info on filesystem at 1676160212518Initializing all the Stores at 1676160212518Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212518Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212518Region opened successfully at 1676160212528 (+10 ms) 2023-02-12 00:03:32,536 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing 55d66e74d9e7592b55b82b07566fa7a3, disabling compactions & flushes 2023-02-12 00:03:32,537 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,537 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,537 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. after waiting 0 ms 2023-02-12 00:03:32,537 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,538 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,538 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for 55d66e74d9e7592b55b82b07566fa7a3: Waiting for close lock at 1676160212536Disabling compacts and flushes for region at 1676160212536Disabling writes for close at 1676160212537 (+1 ms)Writing region close event to WAL at 1676160212538 (+1 ms)Closed at 1676160212538 2023-02-12 00:03:32,538 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,538 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,539 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,541 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:32,541 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1 2023-02-12 00:03:32,542 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb5c28e2c7acbd3022b4552c4e1f78e columnFamilyName f1 2023-02-12 00:03:32,545 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/testWithMockedMapReduceMultiRegion=1fb5c28e2c7acbd3022b4552c4e1f78e-cf5fc316ee654a6f9b5087d3b063e871 2023-02-12 00:03:32,546 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(310): Store=1fb5c28e2c7acbd3022b4552c4e1f78e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,546 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:32,546 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2 2023-02-12 00:03:32,546 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb5c28e2c7acbd3022b4552c4e1f78e columnFamilyName f2 2023-02-12 00:03:32,550 DEBUG [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/testWithMockedMapReduceMultiRegion=1fb5c28e2c7acbd3022b4552c4e1f78e-a9c47429f7814c84bd51a6a34bcbb4db 2023-02-12 00:03:32,550 INFO [StoreOpener-1fb5c28e2c7acbd3022b4552c4e1f78e-1] regionserver.HStore(310): Store=1fb5c28e2c7acbd3022b4552c4e1f78e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,550 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,550 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened 1fb5c28e2c7acbd3022b4552c4e1f78e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73172972, jitterRate=0.09036225080490112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,550 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Writing region info on filesystem at 1676160212539Initializing all the Stores at 1676160212540 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212540Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212540Region opened successfully at 1676160212550 (+10 ms) 2023-02-12 00:03:32,558 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing 1fb5c28e2c7acbd3022b4552c4e1f78e, disabling compactions & flushes 2023-02-12 00:03:32,558 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,558 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,558 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. after waiting 0 ms 2023-02-12 00:03:32,558 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,559 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,559 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Waiting for close lock at 1676160212558Disabling compacts and flushes for region at 1676160212558Disabling writes for close at 1676160212558Writing region close event to WAL at 1676160212559 (+1 ms)Closed at 1676160212559 2023-02-12 00:03:32,559 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,560 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,564 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,565 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:32,566 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1 2023-02-12 00:03:32,566 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f31a13eccfd65e5fe1df5ad209ac0da0 columnFamilyName f1 2023-02-12 00:03:32,570 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/testWithMockedMapReduceMultiRegion=f31a13eccfd65e5fe1df5ad209ac0da0-ccd8576a62c44cbaaac2a2600ce26478 2023-02-12 00:03:32,570 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(310): Store=f31a13eccfd65e5fe1df5ad209ac0da0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,570 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:32,571 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2 2023-02-12 00:03:32,571 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f31a13eccfd65e5fe1df5ad209ac0da0 columnFamilyName f2 2023-02-12 00:03:32,576 DEBUG [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/testWithMockedMapReduceMultiRegion=f31a13eccfd65e5fe1df5ad209ac0da0-219eccb0f6494ac2b3f6a523995dcf58 2023-02-12 00:03:32,576 INFO [StoreOpener-f31a13eccfd65e5fe1df5ad209ac0da0-1] regionserver.HStore(310): Store=f31a13eccfd65e5fe1df5ad209ac0da0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,576 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,576 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened f31a13eccfd65e5fe1df5ad209ac0da0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75062081, jitterRate=0.11851216852664948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,577 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for f31a13eccfd65e5fe1df5ad209ac0da0: Writing region info on filesystem at 1676160212564Initializing all the Stores at 1676160212564Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212564Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212565 (+1 ms)Region opened successfully at 1676160212577 (+12 ms) 2023-02-12 00:03:32,586 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing f31a13eccfd65e5fe1df5ad209ac0da0, disabling compactions & flushes 2023-02-12 00:03:32,586 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,586 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,586 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. after waiting 0 ms 2023-02-12 00:03:32,586 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,587 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,587 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for f31a13eccfd65e5fe1df5ad209ac0da0: Waiting for close lock at 1676160212586Disabling compacts and flushes for region at 1676160212586Disabling writes for close at 1676160212586Writing region close event to WAL at 1676160212587 (+1 ms)Closed at 1676160212587 2023-02-12 00:03:32,588 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,588 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,589 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,590 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:32,591 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1 2023-02-12 00:03:32,591 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b87a34a4b86d36c38b4d76281c22acbf columnFamilyName f1 2023-02-12 00:03:32,594 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/testWithMockedMapReduceMultiRegion=b87a34a4b86d36c38b4d76281c22acbf-b4e877bc315640968307c77bb3e02e14 2023-02-12 00:03:32,594 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(310): Store=b87a34a4b86d36c38b4d76281c22acbf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,595 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:32,595 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2 2023-02-12 00:03:32,595 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b87a34a4b86d36c38b4d76281c22acbf columnFamilyName f2 2023-02-12 00:03:32,599 DEBUG [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/testWithMockedMapReduceMultiRegion=b87a34a4b86d36c38b4d76281c22acbf-1d8af75da6244b5b936af13f7be33b7d 2023-02-12 00:03:32,599 INFO [StoreOpener-b87a34a4b86d36c38b4d76281c22acbf-1] regionserver.HStore(310): Store=b87a34a4b86d36c38b4d76281c22acbf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,599 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,600 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened b87a34a4b86d36c38b4d76281c22acbf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59973719, jitterRate=-0.10632194578647614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,600 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for b87a34a4b86d36c38b4d76281c22acbf: Writing region info on filesystem at 1676160212589Initializing all the Stores at 1676160212589Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212589Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212589Region opened successfully at 1676160212600 (+11 ms) 2023-02-12 00:03:32,607 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing b87a34a4b86d36c38b4d76281c22acbf, disabling compactions & flushes 2023-02-12 00:03:32,608 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,608 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,608 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. after waiting 0 ms 2023-02-12 00:03:32,608 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,614 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,614 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for b87a34a4b86d36c38b4d76281c22acbf: Waiting for close lock at 1676160212607Disabling compacts and flushes for region at 1676160212607Disabling writes for close at 1676160212608 (+1 ms)Writing region close event to WAL at 1676160212614 (+6 ms)Closed at 1676160212614 2023-02-12 00:03:32,614 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,614 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,616 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,617 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:32,618 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1 2023-02-12 00:03:32,618 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64fb799d292322bdadaa323edd87f74 columnFamilyName f1 2023-02-12 00:03:32,622 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/testWithMockedMapReduceMultiRegion=e64fb799d292322bdadaa323edd87f74-079bf01e87624de6b7e836c868f76826 2023-02-12 00:03:32,623 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(310): Store=e64fb799d292322bdadaa323edd87f74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,623 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:32,623 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2 2023-02-12 00:03:32,624 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64fb799d292322bdadaa323edd87f74 columnFamilyName f2 2023-02-12 00:03:32,627 DEBUG [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/testWithMockedMapReduceMultiRegion=e64fb799d292322bdadaa323edd87f74-b85ac8a4aabe407a88a8a9851652ccb6 2023-02-12 00:03:32,627 INFO [StoreOpener-e64fb799d292322bdadaa323edd87f74-1] regionserver.HStore(310): Store=e64fb799d292322bdadaa323edd87f74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,627 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,627 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened e64fb799d292322bdadaa323edd87f74; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71701626, jitterRate=0.06843748688697815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,628 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for e64fb799d292322bdadaa323edd87f74: Writing region info on filesystem at 1676160212616Initializing all the Stores at 1676160212616Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212617 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212617Region opened successfully at 1676160212627 (+10 ms) 2023-02-12 00:03:32,635 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing e64fb799d292322bdadaa323edd87f74, disabling compactions & flushes 2023-02-12 00:03:32,635 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,635 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,635 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. after waiting 0 ms 2023-02-12 00:03:32,635 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,636 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,636 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for e64fb799d292322bdadaa323edd87f74: Waiting for close lock at 1676160212635Disabling compacts and flushes for region at 1676160212635Disabling writes for close at 1676160212635Writing region close event to WAL at 1676160212636 (+1 ms)Closed at 1676160212636 2023-02-12 00:03:32,637 DEBUG [Listener at localhost/38793] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:32,637 INFO [Listener at localhost/38793] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:32,638 DEBUG [Listener at localhost/38793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:32,640 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:32,641 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1 2023-02-12 00:03:32,641 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeb4ce153992da2963d9666d37081bc columnFamilyName f1 2023-02-12 00:03:32,644 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/testWithMockedMapReduceMultiRegion=cfeb4ce153992da2963d9666d37081bc-269c1e01c74b4ba1ada77f5514ca31be 2023-02-12 00:03:32,645 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(310): Store=cfeb4ce153992da2963d9666d37081bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,645 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:32,645 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2 2023-02-12 00:03:32,645 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeb4ce153992da2963d9666d37081bc columnFamilyName f2 2023-02-12 00:03:32,649 DEBUG [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(539): loaded hdfs://localhost:46745/user/jenkins/test-data/ab0681dd-b07d-d605-05d0-99092bb23141/testWithMockedMapReduceMultiRegion/d2fceabd-0cf7-4cd0-bc5b-41342d9c7279/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/testWithMockedMapReduceMultiRegion=cfeb4ce153992da2963d9666d37081bc-68631578ede445df881fd06d0d5e1882 2023-02-12 00:03:32,649 INFO [StoreOpener-cfeb4ce153992da2963d9666d37081bc-1] regionserver.HStore(310): Store=cfeb4ce153992da2963d9666d37081bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:32,649 DEBUG [Listener at localhost/38793] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:32,649 INFO [Listener at localhost/38793] regionserver.HRegion(1071): Opened cfeb4ce153992da2963d9666d37081bc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70078958, jitterRate=0.04425784945487976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:32,649 DEBUG [Listener at localhost/38793] regionserver.HRegion(964): Region open journal for cfeb4ce153992da2963d9666d37081bc: Writing region info on filesystem at 1676160212638Initializing all the Stores at 1676160212639 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212639Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160212639Region opened successfully at 1676160212649 (+10 ms) 2023-02-12 00:03:32,657 DEBUG [Listener at localhost/38793] regionserver.HRegion(1603): Closing cfeb4ce153992da2963d9666d37081bc, disabling compactions & flushes 2023-02-12 00:03:32,657 INFO [Listener at localhost/38793] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,657 DEBUG [Listener at localhost/38793] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,658 DEBUG [Listener at localhost/38793] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. after waiting 0 ms 2023-02-12 00:03:32,658 DEBUG [Listener at localhost/38793] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,658 INFO [Listener at localhost/38793] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,658 DEBUG [Listener at localhost/38793] regionserver.HRegion(1557): Region close journal for cfeb4ce153992da2963d9666d37081bc: Waiting for close lock at 1676160212657Disabling compacts and flushes for region at 1676160212657Disabling writes for close at 1676160212658 (+1 ms)Writing region close event to WAL at 1676160212658Closed at 1676160212658 2023-02-12 00:03:32,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-12 00:03:32,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,665 INFO [Listener at localhost/38793] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,669 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160212669"}]},"ts":"1676160212669"} 2023-02-12 00:03:32,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:32,671 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-12 00:03:32,672 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-12 00:03:32,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, UNASSIGN}] 2023-02-12 00:03:32,675 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, UNASSIGN 2023-02-12 00:03:32,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, UNASSIGN 2023-02-12 00:03:32,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, UNASSIGN 2023-02-12 00:03:32,675 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, UNASSIGN 2023-02-12 00:03:32,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, UNASSIGN 2023-02-12 00:03:32,675 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=55d66e74d9e7592b55b82b07566fa7a3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:32,675 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cfeb4ce153992da2963d9666d37081bc, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:32,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f31a13eccfd65e5fe1df5ad209ac0da0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:32,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212675"}]},"ts":"1676160212675"} 2023-02-12 00:03:32,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a401afb0c77ad416e6b25e0324e1a35c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:32,676 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212675"}]},"ts":"1676160212675"} 2023-02-12 00:03:32,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160212676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212676"}]},"ts":"1676160212676"} 2023-02-12 00:03:32,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=964327a1b0f6ad05f91a89d74776ec07, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:32,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212676"}]},"ts":"1676160212676"} 2023-02-12 00:03:32,676 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160212676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212676"}]},"ts":"1676160212676"} 2023-02-12 00:03:32,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure 55d66e74d9e7592b55b82b07566fa7a3, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:32,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure a401afb0c77ad416e6b25e0324e1a35c, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:32,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure cfeb4ce153992da2963d9666d37081bc, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:32,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure f31a13eccfd65e5fe1df5ad209ac0da0, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:32,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure 964327a1b0f6ad05f91a89d74776ec07, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:32,680 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, UNASSIGN 2023-02-12 00:03:32,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7c164096fdc52b41c29486a367210d62, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:32,681 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212680"}]},"ts":"1676160212680"} 2023-02-12 00:03:32,681 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, UNASSIGN 2023-02-12 00:03:32,681 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, UNASSIGN 2023-02-12 00:03:32,682 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, UNASSIGN 2023-02-12 00:03:32,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1fb5c28e2c7acbd3022b4552c4e1f78e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:32,682 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212682"}]},"ts":"1676160212682"} 2023-02-12 00:03:32,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 7c164096fdc52b41c29486a367210d62, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:32,682 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, UNASSIGN 2023-02-12 00:03:32,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1e1dfc1b1d3b6956b57ea012d19919a9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:32,682 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212682"}]},"ts":"1676160212682"} 2023-02-12 00:03:32,682 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e64fb799d292322bdadaa323edd87f74, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:32,682 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212682"}]},"ts":"1676160212682"} 2023-02-12 00:03:32,683 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b87a34a4b86d36c38b4d76281c22acbf, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:32,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212683"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160212683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160212683"}]},"ts":"1676160212683"} 2023-02-12 00:03:32,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 1fb5c28e2c7acbd3022b4552c4e1f78e, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:32,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 1e1dfc1b1d3b6956b57ea012d19919a9, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:32,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure e64fb799d292322bdadaa323edd87f74, server=jenkins-hbase9.apache.org,41655,1676160207345}] 2023-02-12 00:03:32,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure b87a34a4b86d36c38b4d76281c22acbf, server=jenkins-hbase9.apache.org,41835,1676160207374}] 2023-02-12 00:03:32,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:32,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:32,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 964327a1b0f6ad05f91a89d74776ec07, disabling compactions & flushes 2023-02-12 00:03:32,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. after waiting 0 ms 2023-02-12 00:03:32,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:32,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1fb5c28e2c7acbd3022b4552c4e1f78e, disabling compactions & flushes 2023-02-12 00:03:32,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. after waiting 0 ms 2023-02-12 00:03:32,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:32,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07. 2023-02-12 00:03:32,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 964327a1b0f6ad05f91a89d74776ec07: Waiting for close lock at 1676160212830Running coprocessor pre-close hooks at 1676160212830Disabling compacts and flushes for region at 1676160212830Disabling writes for close at 1676160212830Writing region close event to WAL at 1676160212830Running coprocessor post-close hooks at 1676160212834 (+4 ms)Closed at 1676160212834 2023-02-12 00:03:32,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e. 2023-02-12 00:03:32,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1fb5c28e2c7acbd3022b4552c4e1f78e: Waiting for close lock at 1676160212830Running coprocessor pre-close hooks at 1676160212830Disabling compacts and flushes for region at 1676160212830Disabling writes for close at 1676160212831 (+1 ms)Writing region close event to WAL at 1676160212831Running coprocessor post-close hooks at 1676160212834 (+3 ms)Closed at 1676160212834 2023-02-12 00:03:32,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:32,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:32,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7c164096fdc52b41c29486a367210d62, disabling compactions & flushes 2023-02-12 00:03:32,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. after waiting 0 ms 2023-02-12 00:03:32,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,836 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=964327a1b0f6ad05f91a89d74776ec07, regionState=CLOSED 2023-02-12 00:03:32,836 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160212835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212835"}]},"ts":"1676160212835"} 2023-02-12 00:03:32,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:32,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:32,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f31a13eccfd65e5fe1df5ad209ac0da0, disabling compactions & flushes 2023-02-12 00:03:32,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. after waiting 0 ms 2023-02-12 00:03:32,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1fb5c28e2c7acbd3022b4552c4e1f78e, regionState=CLOSED 2023-02-12 00:03:32,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212836"}]},"ts":"1676160212836"} 2023-02-12 00:03:32,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-12 00:03:32,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure 964327a1b0f6ad05f91a89d74776ec07, server=jenkins-hbase9.apache.org,41835,1676160207374 in 157 msec 2023-02-12 00:03:32,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 00:03:32,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 1fb5c28e2c7acbd3022b4552c4e1f78e, server=jenkins-hbase9.apache.org,41655,1676160207345 in 155 msec 2023-02-12 00:03:32,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=964327a1b0f6ad05f91a89d74776ec07, UNASSIGN in 166 msec 2023-02-12 00:03:32,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62. 2023-02-12 00:03:32,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7c164096fdc52b41c29486a367210d62: Waiting for close lock at 1676160212835Running coprocessor pre-close hooks at 1676160212835Disabling compacts and flushes for region at 1676160212835Disabling writes for close at 1676160212835Writing region close event to WAL at 1676160212837 (+2 ms)Running coprocessor post-close hooks at 1676160212841 (+4 ms)Closed at 1676160212841 2023-02-12 00:03:32,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1fb5c28e2c7acbd3022b4552c4e1f78e, UNASSIGN in 167 msec 2023-02-12 00:03:32,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:32,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:32,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing b87a34a4b86d36c38b4d76281c22acbf, disabling compactions & flushes 2023-02-12 00:03:32,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. after waiting 0 ms 2023-02-12 00:03:32,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,843 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7c164096fdc52b41c29486a367210d62, regionState=CLOSED 2023-02-12 00:03:32,843 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212842"}]},"ts":"1676160212842"} 2023-02-12 00:03:32,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0. 2023-02-12 00:03:32,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f31a13eccfd65e5fe1df5ad209ac0da0: Waiting for close lock at 1676160212836Running coprocessor pre-close hooks at 1676160212836Disabling compacts and flushes for region at 1676160212836Disabling writes for close at 1676160212836Writing region close event to WAL at 1676160212840 (+4 ms)Running coprocessor post-close hooks at 1676160212843 (+3 ms)Closed at 1676160212843 2023-02-12 00:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf. 2023-02-12 00:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for b87a34a4b86d36c38b4d76281c22acbf: Waiting for close lock at 1676160212842Running coprocessor pre-close hooks at 1676160212842Disabling compacts and flushes for region at 1676160212842Disabling writes for close at 1676160212842Writing region close event to WAL at 1676160212844 (+2 ms)Running coprocessor post-close hooks at 1676160212846 (+2 ms)Closed at 1676160212846 2023-02-12 00:03:32,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:32,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:32,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e64fb799d292322bdadaa323edd87f74, disabling compactions & flushes 2023-02-12 00:03:32,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. after waiting 0 ms 2023-02-12 00:03:32,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f31a13eccfd65e5fe1df5ad209ac0da0, regionState=CLOSED 2023-02-12 00:03:32,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212851"}]},"ts":"1676160212851"} 2023-02-12 00:03:32,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 00:03:32,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 7c164096fdc52b41c29486a367210d62, server=jenkins-hbase9.apache.org,41835,1676160207374 in 162 msec 2023-02-12 00:03:32,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:32,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:32,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1e1dfc1b1d3b6956b57ea012d19919a9, disabling compactions & flushes 2023-02-12 00:03:32,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b87a34a4b86d36c38b4d76281c22acbf, regionState=CLOSED 2023-02-12 00:03:32,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. after waiting 0 ms 2023-02-12 00:03:32,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,852 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212852"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212852"}]},"ts":"1676160212852"} 2023-02-12 00:03:32,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c164096fdc52b41c29486a367210d62, UNASSIGN in 178 msec 2023-02-12 00:03:32,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-12 00:03:32,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure f31a13eccfd65e5fe1df5ad209ac0da0, server=jenkins-hbase9.apache.org,41655,1676160207345 in 173 msec 2023-02-12 00:03:32,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-12 00:03:32,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure b87a34a4b86d36c38b4d76281c22acbf, server=jenkins-hbase9.apache.org,41835,1676160207374 in 165 msec 2023-02-12 00:03:32,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f31a13eccfd65e5fe1df5ad209ac0da0, UNASSIGN in 181 msec 2023-02-12 00:03:32,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b87a34a4b86d36c38b4d76281c22acbf, UNASSIGN in 182 msec 2023-02-12 00:03:32,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74. 2023-02-12 00:03:32,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e64fb799d292322bdadaa323edd87f74: Waiting for close lock at 1676160212851Running coprocessor pre-close hooks at 1676160212851Disabling compacts and flushes for region at 1676160212851Disabling writes for close at 1676160212851Writing region close event to WAL at 1676160212853 (+2 ms)Running coprocessor post-close hooks at 1676160212857 (+4 ms)Closed at 1676160212857 2023-02-12 00:03:32,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:32,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:32,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a401afb0c77ad416e6b25e0324e1a35c, disabling compactions & flushes 2023-02-12 00:03:32,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. after waiting 0 ms 2023-02-12 00:03:32,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,858 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e64fb799d292322bdadaa323edd87f74, regionState=CLOSED 2023-02-12 00:03:32,858 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212858"}]},"ts":"1676160212858"} 2023-02-12 00:03:32,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9. 2023-02-12 00:03:32,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1e1dfc1b1d3b6956b57ea012d19919a9: Waiting for close lock at 1676160212852Running coprocessor pre-close hooks at 1676160212852Disabling compacts and flushes for region at 1676160212852Disabling writes for close at 1676160212852Writing region close event to WAL at 1676160212854 (+2 ms)Running coprocessor post-close hooks at 1676160212861 (+7 ms)Closed at 1676160212861 2023-02-12 00:03:32,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-12 00:03:32,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure e64fb799d292322bdadaa323edd87f74, server=jenkins-hbase9.apache.org,41655,1676160207345 in 175 msec 2023-02-12 00:03:32,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 00:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c. 2023-02-12 00:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a401afb0c77ad416e6b25e0324e1a35c: Waiting for close lock at 1676160212858Running coprocessor pre-close hooks at 1676160212858Disabling compacts and flushes for region at 1676160212858Disabling writes for close at 1676160212858Writing region close event to WAL at 1676160212859 (+1 ms)Running coprocessor post-close hooks at 1676160212862 (+3 ms)Closed at 1676160212862 2023-02-12 00:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 55d66e74d9e7592b55b82b07566fa7a3, disabling compactions & flushes 2023-02-12 00:03:32,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e64fb799d292322bdadaa323edd87f74, UNASSIGN in 188 msec 2023-02-12 00:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,862 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1e1dfc1b1d3b6956b57ea012d19919a9, regionState=CLOSED 2023-02-12 00:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. after waiting 0 ms 2023-02-12 00:03:32,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212862"}]},"ts":"1676160212862"} 2023-02-12 00:03:32,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:32,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:32,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing cfeb4ce153992da2963d9666d37081bc, disabling compactions & flushes 2023-02-12 00:03:32,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a401afb0c77ad416e6b25e0324e1a35c, regionState=CLOSED 2023-02-12 00:03:32,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. after waiting 0 ms 2023-02-12 00:03:32,864 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676160212864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212864"}]},"ts":"1676160212864"} 2023-02-12 00:03:32,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3. 2023-02-12 00:03:32,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 55d66e74d9e7592b55b82b07566fa7a3: Waiting for close lock at 1676160212862Running coprocessor pre-close hooks at 1676160212862Disabling compacts and flushes for region at 1676160212862Disabling writes for close at 1676160212863 (+1 ms)Writing region close event to WAL at 1676160212864 (+1 ms)Running coprocessor post-close hooks at 1676160212867 (+3 ms)Closed at 1676160212867 2023-02-12 00:03:32,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:32,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc. 2023-02-12 00:03:32,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for cfeb4ce153992da2963d9666d37081bc: Waiting for close lock at 1676160212863Running coprocessor pre-close hooks at 1676160212863Disabling compacts and flushes for region at 1676160212863Disabling writes for close at 1676160212864 (+1 ms)Writing region close event to WAL at 1676160212866 (+2 ms)Running coprocessor post-close hooks at 1676160212869 (+3 ms)Closed at 1676160212869 2023-02-12 00:03:32,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:32,876 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=55d66e74d9e7592b55b82b07566fa7a3, regionState=CLOSED 2023-02-12 00:03:32,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212876"}]},"ts":"1676160212876"} 2023-02-12 00:03:32,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:32,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-12 00:03:32,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-12 00:03:32,877 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cfeb4ce153992da2963d9666d37081bc, regionState=CLOSED 2023-02-12 00:03:32,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 1e1dfc1b1d3b6956b57ea012d19919a9, server=jenkins-hbase9.apache.org,41835,1676160207374 in 182 msec 2023-02-12 00:03:32,877 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676160212876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160212876"}]},"ts":"1676160212876"} 2023-02-12 00:03:32,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure a401afb0c77ad416e6b25e0324e1a35c, server=jenkins-hbase9.apache.org,41655,1676160207345 in 187 msec 2023-02-12 00:03:32,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e1dfc1b1d3b6956b57ea012d19919a9, UNASSIGN in 203 msec 2023-02-12 00:03:32,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a401afb0c77ad416e6b25e0324e1a35c, UNASSIGN in 204 msec 2023-02-12 00:03:32,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-12 00:03:32,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure 55d66e74d9e7592b55b82b07566fa7a3, server=jenkins-hbase9.apache.org,41835,1676160207374 in 200 msec 2023-02-12 00:03:32,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-12 00:03:32,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55d66e74d9e7592b55b82b07566fa7a3, UNASSIGN in 206 msec 2023-02-12 00:03:32,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure cfeb4ce153992da2963d9666d37081bc, server=jenkins-hbase9.apache.org,41655,1676160207345 in 200 msec 2023-02-12 00:03:32,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-12 00:03:32,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cfeb4ce153992da2963d9666d37081bc, UNASSIGN in 207 msec 2023-02-12 00:03:32,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160212882"}]},"ts":"1676160212882"} 2023-02-12 00:03:32,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-12 00:03:32,884 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-12 00:03:32,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 219 msec 2023-02-12 00:03:32,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 00:03:32,973 INFO [Listener at localhost/38793] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-12 00:03:32,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,976 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,977 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:32,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:32,987 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:32,990 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/recovered.edits] 2023-02-12 00:03:32,991 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/recovered.edits] 2023-02-12 00:03:32,991 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/recovered.edits] 2023-02-12 00:03:32,992 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/recovered.edits] 2023-02-12 00:03:32,992 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/recovered.edits] 2023-02-12 00:03:32,992 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/recovered.edits] 2023-02-12 00:03:32,992 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/recovered.edits] 2023-02-12 00:03:32,993 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/recovered.edits] 2023-02-12 00:03:32,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/ccd8576a62c44cbaaac2a2600ce26478 2023-02-12 00:03:32,999 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/079bf01e87624de6b7e836c868f76826 2023-02-12 00:03:32,999 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/43c3253bfe8a465c950ad4c60d5db0e8 2023-02-12 00:03:32,999 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/95a83f0619514735896594603a3f1302 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/95a83f0619514735896594603a3f1302 2023-02-12 00:03:33,000 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/792a3d5494e4479a80ac64958d0cb323 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/792a3d5494e4479a80ac64958d0cb323 2023-02-12 00:03:33,000 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/269c1e01c74b4ba1ada77f5514ca31be 2023-02-12 00:03:33,000 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/f609b6aa020d46cdafaaf5b1a2150b55 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f1/f609b6aa020d46cdafaaf5b1a2150b55 2023-02-12 00:03:33,001 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/041ed6707ea446a792fb58d98ae6466d to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/041ed6707ea446a792fb58d98ae6466d 2023-02-12 00:03:33,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f1/cf5fc316ee654a6f9b5087d3b063e871 2023-02-12 00:03:33,003 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/83ec2da7897944adb160c6e8f0f97277 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f1/83ec2da7897944adb160c6e8f0f97277 2023-02-12 00:03:33,003 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/c6b442bea5724841a2e5b5f055abf11b to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f1/c6b442bea5724841a2e5b5f055abf11b 2023-02-12 00:03:33,003 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/recovered.edits/6.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07/recovered.edits/6.seqid 2023-02-12 00:03:33,003 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f1/b4e877bc315640968307c77bb3e02e14 2023-02-12 00:03:33,004 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/eaaf5b8f02574269a4feb8bb46a25e2b to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f1/eaaf5b8f02574269a4feb8bb46a25e2b 2023-02-12 00:03:33,005 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/964327a1b0f6ad05f91a89d74776ec07 2023-02-12 00:03:33,005 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:33,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f1/8af20ddfd2b64d87a77676b8265fb682 2023-02-12 00:03:33,007 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/219eccb0f6494ac2b3f6a523995dcf58 2023-02-12 00:03:33,009 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/1d8af75da6244b5b936af13f7be33b7d 2023-02-12 00:03:33,009 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/a77a790867904e888577d95b7a8d4973 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/a77a790867904e888577d95b7a8d4973 2023-02-12 00:03:33,009 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/recovered.edits] 2023-02-12 00:03:33,009 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/a9c47429f7814c84bd51a6a34bcbb4db 2023-02-12 00:03:33,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/554bc1c9f2d94cb7b47f44f730b94f10 2023-02-12 00:03:33,010 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/3c6f3a6c65a24516a9fa96da86606f46 2023-02-12 00:03:33,010 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/3e8fc20a791c4cfba4ca14dba70e777f to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/f2/3e8fc20a791c4cfba4ca14dba70e777f 2023-02-12 00:03:33,011 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/2a9888bd28e94edfbf48376a98421fc8 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/2a9888bd28e94edfbf48376a98421fc8 2023-02-12 00:03:33,011 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/f2/b85ac8a4aabe407a88a8a9851652ccb6 2023-02-12 00:03:33,011 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/f2/8d95017eb66d4e0b85c3a5a01c4dc1d5 2023-02-12 00:03:33,012 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/b9a80c9615f749c8be7e4430b3a1f958 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/f2/b9a80c9615f749c8be7e4430b3a1f958 2023-02-12 00:03:33,013 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/f16dc7df14f14e8d9a762019357e2427 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/f2/f16dc7df14f14e8d9a762019357e2427 2023-02-12 00:03:33,013 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/6521c435a4af4d06a3d418bc2657d937 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/f2/6521c435a4af4d06a3d418bc2657d937 2023-02-12 00:03:33,013 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/f2/68631578ede445df881fd06d0d5e1882 2023-02-12 00:03:33,016 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/7d3b1efd889b42cdb18f7e9d17427c0f 2023-02-12 00:03:33,016 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0/recovered.edits/12.seqid 2023-02-12 00:03:33,017 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf/recovered.edits/12.seqid 2023-02-12 00:03:33,017 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74/recovered.edits/12.seqid 2023-02-12 00:03:33,018 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/f31a13eccfd65e5fe1df5ad209ac0da0 2023-02-12 00:03:33,018 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:33,018 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc/recovered.edits/12.seqid 2023-02-12 00:03:33,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/b87a34a4b86d36c38b4d76281c22acbf 2023-02-12 00:03:33,018 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3/recovered.edits/12.seqid 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/e64fb799d292322bdadaa323edd87f74 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e/recovered.edits/12.seqid 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/b5da4bf5c2f24542a4b222c16dbbbb85 to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f1/b5da4bf5c2f24542a4b222c16dbbbb85 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/cfeb4ce153992da2963d9666d37081bc 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/55d66e74d9e7592b55b82b07566fa7a3 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9/recovered.edits/12.seqid 2023-02-12 00:03:33,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1fb5c28e2c7acbd3022b4552c4e1f78e 2023-02-12 00:03:33,020 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e1dfc1b1d3b6956b57ea012d19919a9 2023-02-12 00:03:33,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f1, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/f2, FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/recovered.edits] 2023-02-12 00:03:33,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/458878506c3545c28d2b813468de1e9c to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/458878506c3545c28d2b813468de1e9c 2023-02-12 00:03:33,023 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/f2/49dc9a371cc544ce9fc526a472efa4fa 2023-02-12 00:03:33,025 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/recovered.edits/6.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c/recovered.edits/6.seqid 2023-02-12 00:03:33,025 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/a401afb0c77ad416e6b25e0324e1a35c 2023-02-12 00:03:33,025 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/recovered.edits/12.seqid to hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/archive/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62/recovered.edits/12.seqid 2023-02-12 00:03:33,026 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c164096fdc52b41c29486a367210d62 2023-02-12 00:03:33,026 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 00:03:33,028 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:33,030 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-12 00:03:33,033 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-12 00:03:33,033 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160213034"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,036 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 00:03:33,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 964327a1b0f6ad05f91a89d74776ec07, NAME => 'testWithMockedMapReduceMultiRegion,,1676160208513.964327a1b0f6ad05f91a89d74776ec07.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => f31a13eccfd65e5fe1df5ad209ac0da0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676160208513.f31a13eccfd65e5fe1df5ad209ac0da0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => b87a34a4b86d36c38b4d76281c22acbf, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676160208513.b87a34a4b86d36c38b4d76281c22acbf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 55d66e74d9e7592b55b82b07566fa7a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676160208513.55d66e74d9e7592b55b82b07566fa7a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => cfeb4ce153992da2963d9666d37081bc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676160208513.cfeb4ce153992da2963d9666d37081bc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => e64fb799d292322bdadaa323edd87f74, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676160208513.e64fb799d292322bdadaa323edd87f74.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 1e1dfc1b1d3b6956b57ea012d19919a9, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676160208513.1e1dfc1b1d3b6956b57ea012d19919a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 1fb5c28e2c7acbd3022b4552c4e1f78e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676160208513.1fb5c28e2c7acbd3022b4552c4e1f78e.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7c164096fdc52b41c29486a367210d62, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676160208513.7c164096fdc52b41c29486a367210d62.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => a401afb0c77ad416e6b25e0324e1a35c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676160208513.a401afb0c77ad416e6b25e0324e1a35c.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 00:03:33,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-12 00:03:33,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160213036"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:33,037 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-12 00:03:33,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 00:03:33,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 65 msec 2023-02-12 00:03:33,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 00:03:33,079 INFO [Listener at localhost/38793] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-12 00:03:33,079 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:33,079 INFO [Listener at localhost/38793] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:33,079 DEBUG [Listener at localhost/38793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a1d4d69 to 127.0.0.1:52767 2023-02-12 00:03:33,079 DEBUG [Listener at localhost/38793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,079 DEBUG [Listener at localhost/38793] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:33,079 DEBUG [Listener at localhost/38793] util.JVMClusterUtil(257): Found active master hash=153293241, stopped=false 2023-02-12 00:03:33,079 INFO [Listener at localhost/38793] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:33,083 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:33,083 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:33,083 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:33,083 INFO [Listener at localhost/38793] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:33,083 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:33,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:33,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:33,085 DEBUG [Listener at localhost/38793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f711dde to 127.0.0.1:52767 2023-02-12 00:03:33,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:33,085 DEBUG [Listener at localhost/38793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,085 INFO [Listener at localhost/38793] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41655,1676160207345' ***** 2023-02-12 00:03:33,085 INFO [Listener at localhost/38793] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:33,085 INFO [Listener at localhost/38793] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41835,1676160207374' ***** 2023-02-12 00:03:33,085 INFO [Listener at localhost/38793] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:33,085 INFO [RS:0;jenkins-hbase9:41655] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:33,085 INFO [RS:1;jenkins-hbase9:41835] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:33,085 INFO [RS:0;jenkins-hbase9:41655] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:33,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:33,085 INFO [RS:0;jenkins-hbase9:41655] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:33,085 INFO [RS:1;jenkins-hbase9:41835] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:33,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:33,087 INFO [RS:1;jenkins-hbase9:41835] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:33,087 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(3304): Received CLOSE for a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:33,088 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:33,088 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:33,088 DEBUG [RS:1;jenkins-hbase9:41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x147e08f4 to 127.0.0.1:52767 2023-02-12 00:03:33,088 DEBUG [RS:0;jenkins-hbase9:41655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c695a9 to 127.0.0.1:52767 2023-02-12 00:03:33,089 DEBUG [RS:1;jenkins-hbase9:41835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a99219206ff4bfc2b8ee5e29953c39c3, disabling compactions & flushes 2023-02-12 00:03:33,089 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41835,1676160207374; all regions closed. 2023-02-12 00:03:33,089 DEBUG [RS:0;jenkins-hbase9:41655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:33,089 INFO [RS:0;jenkins-hbase9:41655] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:33,089 INFO [RS:0;jenkins-hbase9:41655] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:33,089 INFO [RS:0;jenkins-hbase9:41655] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:33,089 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. after waiting 0 ms 2023-02-12 00:03:33,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:33,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing a99219206ff4bfc2b8ee5e29953c39c3 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:33,089 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 00:03:33,089 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a99219206ff4bfc2b8ee5e29953c39c3=hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3.} 2023-02-12 00:03:33,090 DEBUG [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1505): Waiting on 1588230740, a99219206ff4bfc2b8ee5e29953c39c3 2023-02-12 00:03:33,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:33,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:33,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:33,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:33,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:33,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-12 00:03:33,095 DEBUG [RS:1;jenkins-hbase9:41835] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs 2023-02-12 00:03:33,096 INFO [RS:1;jenkins-hbase9:41835] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41835%2C1676160207374:(num 1676160208688) 2023-02-12 00:03:33,096 DEBUG [RS:1;jenkins-hbase9:41835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,096 INFO [RS:1;jenkins-hbase9:41835] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:33,099 INFO [RS:1;jenkins-hbase9:41835] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:33,099 INFO [RS:1;jenkins-hbase9:41835] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:33,099 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:33,099 INFO [RS:1;jenkins-hbase9:41835] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:33,099 INFO [RS:1;jenkins-hbase9:41835] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:33,100 INFO [RS:1;jenkins-hbase9:41835] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41835 2023-02-12 00:03:33,105 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:33,105 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:33,105 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41835,1676160207374 2023-02-12 00:03:33,105 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:33,105 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:33,105 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b9e22 rejected from java.util.concurrent.ThreadPoolExecutor@4740af3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,105 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41835,1676160207374] 2023-02-12 00:03:33,105 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41835,1676160207374; numProcessing=1 2023-02-12 00:03:33,107 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41835,1676160207374 already deleted, retry=false 2023-02-12 00:03:33,107 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41835,1676160207374 expired; onlineServers=1 2023-02-12 00:03:33,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/.tmp/info/73c201a0b3dc48788dcc8e6ad2d16493 2023-02-12 00:03:33,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/info/d4eaa17790444ae6b32e27264212e415 2023-02-12 00:03:33,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/.tmp/info/73c201a0b3dc48788dcc8e6ad2d16493 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/info/73c201a0b3dc48788dcc8e6ad2d16493 2023-02-12 00:03:33,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4eaa17790444ae6b32e27264212e415 2023-02-12 00:03:33,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/info/73c201a0b3dc48788dcc8e6ad2d16493, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:33,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a99219206ff4bfc2b8ee5e29953c39c3 in 33ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:33,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/rep_barrier/aab16cf6cea049d5a9da5e18aa413d7c 2023-02-12 00:03:33,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/namespace/a99219206ff4bfc2b8ee5e29953c39c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:33,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:33,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a99219206ff4bfc2b8ee5e29953c39c3: Waiting for close lock at 1676160213088Running coprocessor pre-close hooks at 1676160213088Disabling compacts and flushes for region at 1676160213088Disabling writes for close at 1676160213089 (+1 ms)Obtaining lock to block concurrent updates at 1676160213089Preparing flush snapshotting stores in a99219206ff4bfc2b8ee5e29953c39c3 at 1676160213089Finished memstore snapshotting hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160213089Flushing stores of hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. at 1676160213093 (+4 ms)Flushing a99219206ff4bfc2b8ee5e29953c39c3/info: creating writer at 1676160213093Flushing a99219206ff4bfc2b8ee5e29953c39c3/info: appending metadata at 1676160213099 (+6 ms)Flushing a99219206ff4bfc2b8ee5e29953c39c3/info: closing flushed file at 1676160213099Flushing a99219206ff4bfc2b8ee5e29953c39c3/info: reopening flushed file at 1676160213118 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a99219206ff4bfc2b8ee5e29953c39c3 in 33ms, sequenceid=6, compaction requested=false at 1676160213122 (+4 ms)Writing region close event to WAL at 1676160213122Running coprocessor post-close hooks at 1676160213128 (+6 ms)Closed at 1676160213129 (+1 ms) 2023-02-12 00:03:33,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160207956.a99219206ff4bfc2b8ee5e29953c39c3. 2023-02-12 00:03:33,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aab16cf6cea049d5a9da5e18aa413d7c 2023-02-12 00:03:33,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/table/518f698e3b8944e081835a0233399010 2023-02-12 00:03:33,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 518f698e3b8944e081835a0233399010 2023-02-12 00:03:33,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/info/d4eaa17790444ae6b32e27264212e415 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/info/d4eaa17790444ae6b32e27264212e415 2023-02-12 00:03:33,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4eaa17790444ae6b32e27264212e415 2023-02-12 00:03:33,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/info/d4eaa17790444ae6b32e27264212e415, entries=30, sequenceid=57, filesize=8.3 K 2023-02-12 00:03:33,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/rep_barrier/aab16cf6cea049d5a9da5e18aa413d7c as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/rep_barrier/aab16cf6cea049d5a9da5e18aa413d7c 2023-02-12 00:03:33,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aab16cf6cea049d5a9da5e18aa413d7c 2023-02-12 00:03:33,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/rep_barrier/aab16cf6cea049d5a9da5e18aa413d7c, entries=10, sequenceid=57, filesize=6.1 K 2023-02-12 00:03:33,147 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/.tmp/table/518f698e3b8944e081835a0233399010 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/table/518f698e3b8944e081835a0233399010 2023-02-12 00:03:33,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 518f698e3b8944e081835a0233399010 2023-02-12 00:03:33,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/table/518f698e3b8944e081835a0233399010, entries=13, sequenceid=57, filesize=6.1 K 2023-02-12 00:03:33,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false 2023-02-12 00:03:33,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 00:03:33,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:33,165 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:33,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:33,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160213090Running coprocessor pre-close hooks at 1676160213090Disabling compacts and flushes for region at 1676160213090Disabling writes for close at 1676160213093 (+3 ms)Obtaining lock to block concurrent updates at 1676160213093Preparing flush snapshotting stores in 1588230740 at 1676160213093Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676160213093Flushing stores of hbase:meta,,1.1588230740 at 1676160213099 (+6 ms)Flushing 1588230740/info: creating writer at 1676160213099Flushing 1588230740/info: appending metadata at 1676160213105 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676160213105Flushing 1588230740/rep_barrier: creating writer at 1676160213116 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160213119 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160213119Flushing 1588230740/table: creating writer at 1676160213130 (+11 ms)Flushing 1588230740/table: appending metadata at 1676160213131 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676160213131Flushing 1588230740/info: reopening flushed file at 1676160213139 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160213143 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676160213147 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false at 1676160213159 (+12 ms)Writing region close event to WAL at 1676160213161 (+2 ms)Running coprocessor post-close hooks at 1676160213164 (+3 ms)Closed at 1676160213165 (+1 ms) 2023-02-12 00:03:33,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:33,170 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:33,283 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,283 INFO [RS:1;jenkins-hbase9:41835] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41835,1676160207374; zookeeper connection closed. 2023-02-12 00:03:33,283 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c9b75cd rejected from java.util.concurrent.ThreadPoolExecutor@4740af3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,283 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10045d7e9990002, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,283 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5712dea0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5712dea0 2023-02-12 00:03:33,283 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54faeb8c rejected from java.util.concurrent.ThreadPoolExecutor@4740af3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,290 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41655,1676160207345; all regions closed. 2023-02-12 00:03:33,294 DEBUG [RS:0;jenkins-hbase9:41655] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs 2023-02-12 00:03:33,294 INFO [RS:0;jenkins-hbase9:41655] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41655%2C1676160207345.meta:.meta(num 1676160207901) 2023-02-12 00:03:33,297 DEBUG [RS:0;jenkins-hbase9:41655] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/oldWALs 2023-02-12 00:03:33,297 INFO [RS:0;jenkins-hbase9:41655] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41655%2C1676160207345:(num 1676160208312) 2023-02-12 00:03:33,297 DEBUG [RS:0;jenkins-hbase9:41655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,297 INFO [RS:0;jenkins-hbase9:41655] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:33,298 INFO [RS:0;jenkins-hbase9:41655] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:33,298 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:33,299 INFO [RS:0;jenkins-hbase9:41655] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41655 2023-02-12 00:03:33,300 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41655,1676160207345 2023-02-12 00:03:33,300 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:33,300 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20fa0dc5 rejected from java.util.concurrent.ThreadPoolExecutor@24c59d02[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,302 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41655,1676160207345] 2023-02-12 00:03:33,302 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41655,1676160207345; numProcessing=2 2023-02-12 00:03:33,303 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41655,1676160207345 already deleted, retry=false 2023-02-12 00:03:33,303 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41655,1676160207345 expired; onlineServers=0 2023-02-12 00:03:33,303 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,36145,1676160207297' ***** 2023-02-12 00:03:33,303 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:33,305 DEBUG [M:0;jenkins-hbase9:36145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d1c9445, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:33,305 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,36145,1676160207297 2023-02-12 00:03:33,305 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,36145,1676160207297; all regions closed. 2023-02-12 00:03:33,305 DEBUG [M:0;jenkins-hbase9:36145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:33,305 DEBUG [M:0;jenkins-hbase9:36145] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:33,305 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:33,305 DEBUG [M:0;jenkins-hbase9:36145] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:33,306 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160207546] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160207546,5,FailOnTimeoutGroup] 2023-02-12 00:03:33,306 INFO [M:0;jenkins-hbase9:36145] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:33,306 INFO [M:0;jenkins-hbase9:36145] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:33,306 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160207546] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160207546,5,FailOnTimeoutGroup] 2023-02-12 00:03:33,307 INFO [M:0;jenkins-hbase9:36145] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:33,307 DEBUG [M:0;jenkins-hbase9:36145] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:33,307 INFO [M:0;jenkins-hbase9:36145] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:33,307 ERROR [M:0;jenkins-hbase9:36145] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:33,308 INFO [M:0;jenkins-hbase9:36145] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:33,308 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:33,308 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:33,308 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:33,308 DEBUG [M:0;jenkins-hbase9:36145] zookeeper.ZKUtil(398): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:33,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:33,308 WARN [M:0;jenkins-hbase9:36145] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:33,308 INFO [M:0;jenkins-hbase9:36145] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:33,309 INFO [M:0;jenkins-hbase9:36145] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:33,309 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:33,309 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:33,309 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:33,309 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:33,309 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:33,309 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.13 KB heapSize=200.04 KB 2023-02-12 00:03:33,317 INFO [M:0;jenkins-hbase9:36145] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.13 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b5513c38d0784dca8e497e824a15f941 2023-02-12 00:03:33,321 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b5513c38d0784dca8e497e824a15f941 as hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b5513c38d0784dca8e497e824a15f941 2023-02-12 00:03:33,324 INFO [M:0;jenkins-hbase9:36145] regionserver.HStore(1080): Added hdfs://localhost:46745/user/jenkins/test-data/a7a2853f-a143-5417-e751-1a1581e6ec42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b5513c38d0784dca8e497e824a15f941, entries=53, sequenceid=357, filesize=10.7 K 2023-02-12 00:03:33,324 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegion(2947): Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-12 00:03:33,325 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:33,325 DEBUG [M:0;jenkins-hbase9:36145] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160213309Disabling compacts and flushes for region at 1676160213309Disabling writes for close at 1676160213309Obtaining lock to block concurrent updates at 1676160213309Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160213309Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171142, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676160213309Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160213310 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160213310Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160213312 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160213312Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160213321 (+9 ms)Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false at 1676160213324 (+3 ms)Writing region close event to WAL at 1676160213325 (+1 ms)Closed at 1676160213325 2023-02-12 00:03:33,327 INFO [M:0;jenkins-hbase9:36145] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:33,327 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:33,328 INFO [M:0;jenkins-hbase9:36145] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36145 2023-02-12 00:03:33,330 DEBUG [M:0;jenkins-hbase9:36145] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,36145,1676160207297 already deleted, retry=false 2023-02-12 00:03:33,685 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,685 INFO [M:0;jenkins-hbase9:36145] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,36145,1676160207297; zookeeper connection closed. 2023-02-12 00:03:33,685 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f598167 rejected from java.util.concurrent.ThreadPoolExecutor@1b661654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,686 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): master:36145-0x10045d7e9990000, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,686 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cf1bae9 rejected from java.util.concurrent.ThreadPoolExecutor@1b661654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,785 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,785 INFO [RS:0;jenkins-hbase9:41655] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41655,1676160207345; zookeeper connection closed. 2023-02-12 00:03:33,785 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2088f3d2 rejected from java.util.concurrent.ThreadPoolExecutor@24c59d02[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,785 DEBUG [Listener at localhost/38793-EventThread] zookeeper.ZKWatcher(600): regionserver:41655-0x10045d7e9990001, quorum=127.0.0.1:52767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:33,785 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30c839a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30c839a6 2023-02-12 00:03:33,785 ERROR [Listener at localhost/38793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58c9eca1 rejected from java.util.concurrent.ThreadPoolExecutor@24c59d02[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:33,785 INFO [Listener at localhost/38793] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:33,787 WARN [Listener at localhost/38793] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:33,790 INFO [Listener at localhost/38793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:33,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:33,904 WARN [BP-1454044723-172.31.2.10-1676160206714 heartbeating to localhost/127.0.0.1:46745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:33,904 WARN [BP-1454044723-172.31.2.10-1676160206714 heartbeating to localhost/127.0.0.1:46745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1454044723-172.31.2.10-1676160206714 (Datanode Uuid 3b6aa4fe-fea5-46a7-95c0-c1a91a417cfb) service to localhost/127.0.0.1:46745 2023-02-12 00:03:33,905 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/dfs/data/data3/current/BP-1454044723-172.31.2.10-1676160206714] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:33,905 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/dfs/data/data4/current/BP-1454044723-172.31.2.10-1676160206714] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:33,906 WARN [Listener at localhost/38793] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:33,910 INFO [Listener at localhost/38793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:34,016 WARN [BP-1454044723-172.31.2.10-1676160206714 heartbeating to localhost/127.0.0.1:46745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:34,017 WARN [BP-1454044723-172.31.2.10-1676160206714 heartbeating to localhost/127.0.0.1:46745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1454044723-172.31.2.10-1676160206714 (Datanode Uuid e8697f9b-3415-4cd0-b2e0-ee4771a66aeb) service to localhost/127.0.0.1:46745 2023-02-12 00:03:34,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/dfs/data/data1/current/BP-1454044723-172.31.2.10-1676160206714] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:34,018 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/cluster_b45af241-d72c-32c6-6734-89d3fee90696/dfs/data/data2/current/BP-1454044723-172.31.2.10-1676160206714] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:34,027 INFO [Listener at localhost/38793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:34,147 INFO [Listener at localhost/38793] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:34,183 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:34,198 INFO [Listener at localhost/38793] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 178) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38793 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46745 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:46745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:46745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46745 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,36145,1676160207297)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38793.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=638 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9372 (was 9445) 2023-02-12 00:03:34,208 INFO [Listener at localhost/38793] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=167, AvailableMemoryMB=9371 2023-02-12 00:03:34,218 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.log.dir so I do NOT create it in target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383 2023-02-12 00:03:34,218 WARN [Listener at localhost/38793] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:34,218 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.tmp.dir so I do NOT create it in target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383 2023-02-12 00:03:34,218 WARN [Listener at localhost/38793] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59ce6767-bf54-8ad1-1f51-f1ea2cf064d2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:34,218 DEBUG [Listener at localhost/38793] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383 2023-02-12 00:03:34,218 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:34,218 INFO [Listener at localhost/38793] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e, deleteOnExit=true 2023-02-12 00:03:34,218 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/test.cache.data in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:34,219 DEBUG [Listener at localhost/38793] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:34,219 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:34,220 INFO [Listener at localhost/38793] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:34,224 WARN [Listener at localhost/38793] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:34,225 WARN [Listener at localhost/38793] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:34,303 WARN [Listener at localhost/38793] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:34,306 INFO [Listener at localhost/38793] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:34,312 INFO [Listener at localhost/38793] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/java.io.tmpdir/Jetty_localhost_33667_hdfs____3wu20x/webapp 2023-02-12 00:03:34,403 INFO [Listener at localhost/38793] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33667 2023-02-12 00:03:34,407 WARN [Listener at localhost/38793] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:34,407 WARN [Listener at localhost/38793] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:34,446 WARN [Listener at localhost/35029] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:34,468 WARN [Listener at localhost/35029] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:34,471 WARN [Listener at localhost/35029] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:34,473 INFO [Listener at localhost/35029] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:34,478 INFO [Listener at localhost/35029] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/java.io.tmpdir/Jetty_localhost_39029_datanode____.3k9aa0/webapp 2023-02-12 00:03:34,574 INFO [Listener at localhost/35029] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39029 2023-02-12 00:03:34,584 WARN [Listener at localhost/35153] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:34,600 WARN [Listener at localhost/35153] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:34,603 WARN [Listener at localhost/35153] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:34,604 INFO [Listener at localhost/35153] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:34,609 INFO [Listener at localhost/35153] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/java.io.tmpdir/Jetty_localhost_33633_datanode____4cm271/webapp 2023-02-12 00:03:34,697 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1cc839bb22930c41: Processing first storage report for DS-d12c593b-717b-4856-9d95-93a20ab4902f from datanode 5bb8d1fa-8334-4720-968d-19cd77628ec9 2023-02-12 00:03:34,697 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1cc839bb22930c41: from storage DS-d12c593b-717b-4856-9d95-93a20ab4902f node DatanodeRegistration(127.0.0.1:41129, datanodeUuid=5bb8d1fa-8334-4720-968d-19cd77628ec9, infoPort=44905, infoSecurePort=0, ipcPort=35153, storageInfo=lv=-57;cid=testClusterID;nsid=1613150928;c=1676160214261), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:34,697 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1cc839bb22930c41: Processing first storage report for DS-50a085cd-5615-455b-aa74-054ccd0fe5e9 from datanode 5bb8d1fa-8334-4720-968d-19cd77628ec9 2023-02-12 00:03:34,697 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1cc839bb22930c41: from storage DS-50a085cd-5615-455b-aa74-054ccd0fe5e9 node DatanodeRegistration(127.0.0.1:41129, datanodeUuid=5bb8d1fa-8334-4720-968d-19cd77628ec9, infoPort=44905, infoSecurePort=0, ipcPort=35153, storageInfo=lv=-57;cid=testClusterID;nsid=1613150928;c=1676160214261), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:34,719 INFO [Listener at localhost/35153] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33633 2023-02-12 00:03:34,726 WARN [Listener at localhost/44385] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:34,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcfc8fbc467357a05: Processing first storage report for DS-72b0358e-dfbb-4501-ab32-0b9385d26552 from datanode f9d61a40-5047-4158-baf1-fd7c9eae4564 2023-02-12 00:03:34,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcfc8fbc467357a05: from storage DS-72b0358e-dfbb-4501-ab32-0b9385d26552 node DatanodeRegistration(127.0.0.1:39975, datanodeUuid=f9d61a40-5047-4158-baf1-fd7c9eae4564, infoPort=39399, infoSecurePort=0, ipcPort=44385, storageInfo=lv=-57;cid=testClusterID;nsid=1613150928;c=1676160214261), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:34,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcfc8fbc467357a05: Processing first storage report for DS-57690659-4aef-49c2-b674-b37ba60e59b7 from datanode f9d61a40-5047-4158-baf1-fd7c9eae4564 2023-02-12 00:03:34,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcfc8fbc467357a05: from storage DS-57690659-4aef-49c2-b674-b37ba60e59b7 node DatanodeRegistration(127.0.0.1:39975, datanodeUuid=f9d61a40-5047-4158-baf1-fd7c9eae4564, infoPort=39399, infoSecurePort=0, ipcPort=44385, storageInfo=lv=-57;cid=testClusterID;nsid=1613150928;c=1676160214261), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:34,833 DEBUG [Listener at localhost/44385] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383 2023-02-12 00:03:34,835 INFO [Listener at localhost/44385] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/zookeeper_0, clientPort=55426, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:34,836 INFO [Listener at localhost/44385] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55426 2023-02-12 00:03:34,836 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,837 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,851 INFO [Listener at localhost/44385] util.FSUtils(479): Created version file at hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877 with version=8 2023-02-12 00:03:34,851 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,852 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,853 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/hbase-staging 2023-02-12 00:03:34,855 INFO [Listener at localhost/44385] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:34,855 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,855 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,856 INFO [Listener at localhost/44385] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:34,856 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,856 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:34,856 INFO [Listener at localhost/44385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:34,857 INFO [Listener at localhost/44385] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35943 2023-02-12 00:03:34,857 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,858 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,859 INFO [Listener at localhost/44385] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35943 connecting to ZooKeeper ensemble=127.0.0.1:55426 2023-02-12 00:03:34,872 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:359430x0, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:34,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35943-0x10045d807210000 connected 2023-02-12 00:03:34,889 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:34,889 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:34,889 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:34,891 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35943 2023-02-12 00:03:34,891 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35943 2023-02-12 00:03:34,892 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35943 2023-02-12 00:03:34,892 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35943 2023-02-12 00:03:34,892 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35943 2023-02-12 00:03:34,892 INFO [Listener at localhost/44385] master.HMaster(439): hbase.rootdir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877, hbase.cluster.distributed=false 2023-02-12 00:03:34,906 INFO [Listener at localhost/44385] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:34,907 INFO [Listener at localhost/44385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:34,908 INFO [Listener at localhost/44385] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45447 2023-02-12 00:03:34,908 INFO [Listener at localhost/44385] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:34,911 DEBUG [Listener at localhost/44385] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:34,911 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,912 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,913 INFO [Listener at localhost/44385] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45447 connecting to ZooKeeper ensemble=127.0.0.1:55426 2023-02-12 00:03:34,916 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:454470x0, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:34,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45447-0x10045d807210001 connected 2023-02-12 00:03:34,917 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:34,918 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:34,918 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:34,919 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45447 2023-02-12 00:03:34,919 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45447 2023-02-12 00:03:34,923 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45447 2023-02-12 00:03:34,923 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45447 2023-02-12 00:03:34,923 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45447 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:34,934 INFO [Listener at localhost/44385] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:34,935 INFO [Listener at localhost/44385] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43889 2023-02-12 00:03:34,935 INFO [Listener at localhost/44385] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:34,936 DEBUG [Listener at localhost/44385] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:34,936 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,937 INFO [Listener at localhost/44385] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,938 INFO [Listener at localhost/44385] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43889 connecting to ZooKeeper ensemble=127.0.0.1:55426 2023-02-12 00:03:34,941 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:438890x0, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:34,942 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:438890x0, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:34,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43889-0x10045d807210002 connected 2023-02-12 00:03:34,943 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:34,944 DEBUG [Listener at localhost/44385] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:34,947 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43889 2023-02-12 00:03:34,947 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43889 2023-02-12 00:03:34,948 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43889 2023-02-12 00:03:34,949 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43889 2023-02-12 00:03:34,951 DEBUG [Listener at localhost/44385] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43889 2023-02-12 00:03:34,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:34,954 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:34,954 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:34,957 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:34,957 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:34,957 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:34,957 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:34,958 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:34,959 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35943,1676160214855 from backup master directory 2023-02-12 00:03:34,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:34,960 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:34,960 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:34,960 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:34,960 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:34,972 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/hbase.id with ID: cc45bce4-e523-419f-8b78-8000b043a2d8 2023-02-12 00:03:34,982 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:34,984 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:34,993 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x529fc8cf to 127.0.0.1:55426 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:34,997 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40a5bb77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:34,997 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:34,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:34,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:34,999 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store-tmp 2023-02-12 00:03:35,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:35,006 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:35,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:35,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:35,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:35,007 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:35,007 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160215006Disabling compacts and flushes for region at 1676160215006Disabling writes for close at 1676160215006Writing region close event to WAL at 1676160215007 (+1 ms)Closed at 1676160215007 2023-02-12 00:03:35,007 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/WALs/jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:35,009 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35943%2C1676160214855, suffix=, logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/WALs/jenkins-hbase9.apache.org,35943,1676160214855, archiveDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:35,022 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK] 2023-02-12 00:03:35,022 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK] 2023-02-12 00:03:35,024 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/WALs/jenkins-hbase9.apache.org,35943,1676160214855/jenkins-hbase9.apache.org%2C35943%2C1676160214855.1676160215009 2023-02-12 00:03:35,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK], DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK]] 2023-02-12 00:03:35,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:35,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,025 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,026 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:35,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:35,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,028 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,028 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:35,031 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:35,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70434668, jitterRate=0.04955834150314331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:35,031 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160215024Initializing all the Stores at 1676160215025 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160215025Cleaning up temporary data from old regions at 1676160215028 (+3 ms)Cleaning up detritus from prior splits at 1676160215028Region opened successfully at 1676160215031 (+3 ms) 2023-02-12 00:03:35,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:35,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:35,035 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:35,036 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:35,046 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:35,046 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:35,046 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:35,046 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:35,047 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:35,049 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,050 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:35,050 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:35,051 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:35,052 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:35,052 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:35,052 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:35,052 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,052 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,35943,1676160214855, sessionid=0x10045d807210000, setting cluster-up flag (Was=false) 2023-02-12 00:03:35,056 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,061 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:35,062 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:35,066 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,069 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:35,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:35,070 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/.tmp 2023-02-12 00:03:35,071 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:35,072 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,073 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160245073 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:35,074 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:35,074 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:35,074 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:35,075 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,075 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:35,075 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:35,075 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:35,076 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160215076,5,FailOnTimeoutGroup] 2023-02-12 00:03:35,076 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160215076,5,FailOnTimeoutGroup] 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,076 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,089 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:35,089 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:35,089 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877 2023-02-12 00:03:35,094 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:35,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/info 2023-02-12 00:03:35,097 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:35,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:35,098 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:35,098 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:35,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:35,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/table 2023-02-12 00:03:35,100 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:35,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,101 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740 2023-02-12 00:03:35,101 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740 2023-02-12 00:03:35,102 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:35,103 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:35,105 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:35,105 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67004566, jitterRate=-0.0015541613101959229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:35,105 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160215095Initializing all the Stores at 1676160215095Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160215095Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160215095Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160215095Cleaning up temporary data from old regions at 1676160215102 (+7 ms)Cleaning up detritus from prior splits at 1676160215102Region opened successfully at 1676160215105 (+3 ms) 2023-02-12 00:03:35,105 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:35,105 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:35,105 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:35,105 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:35,106 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:35,106 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:35,106 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160215105Disabling compacts and flushes for region at 1676160215105Disabling writes for close at 1676160215106 (+1 ms)Writing region close event to WAL at 1676160215106Closed at 1676160215106 2023-02-12 00:03:35,106 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:35,107 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:35,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:35,108 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:35,109 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:35,153 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(952): ClusterId : cc45bce4-e523-419f-8b78-8000b043a2d8 2023-02-12 00:03:35,153 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(952): ClusterId : cc45bce4-e523-419f-8b78-8000b043a2d8 2023-02-12 00:03:35,153 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:35,153 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:35,156 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:35,156 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:35,156 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:35,156 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:35,158 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:35,160 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:35,160 DEBUG [RS:1;jenkins-hbase9:43889] zookeeper.ReadOnlyZKClient(139): Connect 0x6f7e6ae8 to 127.0.0.1:55426 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:35,161 DEBUG [RS:0;jenkins-hbase9:45447] zookeeper.ReadOnlyZKClient(139): Connect 0x02c879d6 to 127.0.0.1:55426 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:35,170 DEBUG [RS:1;jenkins-hbase9:43889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61b98977, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:35,171 DEBUG [RS:0;jenkins-hbase9:45447] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c0f87ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:35,171 DEBUG [RS:1;jenkins-hbase9:43889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65860198, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:35,171 DEBUG [RS:0;jenkins-hbase9:45447] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@83012a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:35,179 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45447 2023-02-12 00:03:35,179 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:43889 2023-02-12 00:03:35,179 INFO [RS:0;jenkins-hbase9:45447] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:35,179 INFO [RS:0;jenkins-hbase9:45447] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:35,179 INFO [RS:1;jenkins-hbase9:43889] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:35,180 INFO [RS:1;jenkins-hbase9:43889] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:35,179 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:35,180 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:35,180 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35943,1676160214855 with isa=jenkins-hbase9.apache.org/172.31.2.10:43889, startcode=1676160214933 2023-02-12 00:03:35,180 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35943,1676160214855 with isa=jenkins-hbase9.apache.org/172.31.2.10:45447, startcode=1676160214906 2023-02-12 00:03:35,180 DEBUG [RS:0;jenkins-hbase9:45447] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:35,180 DEBUG [RS:1;jenkins-hbase9:43889] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:35,182 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48835, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:35,182 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54459, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:35,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35943] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,183 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,184 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877 2023-02-12 00:03:35,184 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35029 2023-02-12 00:03:35,184 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:35,184 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877 2023-02-12 00:03:35,184 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35029 2023-02-12 00:03:35,184 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:35,189 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:35,189 DEBUG [RS:1;jenkins-hbase9:43889] zookeeper.ZKUtil(162): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,189 DEBUG [RS:0;jenkins-hbase9:45447] zookeeper.ZKUtil(162): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,189 WARN [RS:1;jenkins-hbase9:43889] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:35,189 WARN [RS:0;jenkins-hbase9:45447] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:35,190 INFO [RS:1;jenkins-hbase9:43889] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:35,190 INFO [RS:0;jenkins-hbase9:45447] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:35,190 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,190 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,190 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43889,1676160214933] 2023-02-12 00:03:35,190 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45447,1676160214906] 2023-02-12 00:03:35,197 DEBUG [RS:1;jenkins-hbase9:43889] zookeeper.ZKUtil(162): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,197 DEBUG [RS:0;jenkins-hbase9:45447] zookeeper.ZKUtil(162): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,197 DEBUG [RS:1;jenkins-hbase9:43889] zookeeper.ZKUtil(162): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,197 DEBUG [RS:0;jenkins-hbase9:45447] zookeeper.ZKUtil(162): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,198 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:35,198 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:35,198 INFO [RS:1;jenkins-hbase9:43889] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:35,198 INFO [RS:0;jenkins-hbase9:45447] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:35,199 INFO [RS:1;jenkins-hbase9:43889] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:35,199 INFO [RS:1;jenkins-hbase9:43889] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:35,199 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,199 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:35,200 INFO [RS:0;jenkins-hbase9:45447] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:35,203 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,203 INFO [RS:0;jenkins-hbase9:45447] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:35,203 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,203 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,204 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,204 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:35,204 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,204 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,204 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,205 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:35,205 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,205 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,205 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,205 DEBUG [RS:1;jenkins-hbase9:43889] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,206 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,206 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,206 DEBUG [RS:0;jenkins-hbase9:45447] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:35,211 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,211 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,211 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,218 INFO [RS:1;jenkins-hbase9:43889] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:35,218 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43889,1676160214933-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,223 INFO [RS:0;jenkins-hbase9:45447] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:35,223 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45447,1676160214906-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,228 INFO [RS:1;jenkins-hbase9:43889] regionserver.Replication(203): jenkins-hbase9.apache.org,43889,1676160214933 started 2023-02-12 00:03:35,228 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,43889,1676160214933, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43889, sessionid=0x10045d807210002 2023-02-12 00:03:35,228 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:35,228 DEBUG [RS:1;jenkins-hbase9:43889] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,228 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43889,1676160214933' 2023-02-12 00:03:35,228 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:35,228 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43889,1676160214933' 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:35,229 DEBUG [RS:1;jenkins-hbase9:43889] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:35,229 INFO [RS:1;jenkins-hbase9:43889] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:35,229 INFO [RS:1;jenkins-hbase9:43889] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:35,235 INFO [RS:0;jenkins-hbase9:45447] regionserver.Replication(203): jenkins-hbase9.apache.org,45447,1676160214906 started 2023-02-12 00:03:35,235 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45447,1676160214906, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45447, sessionid=0x10045d807210001 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45447,1676160214906' 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45447,1676160214906' 2023-02-12 00:03:35,235 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:35,236 DEBUG [RS:0;jenkins-hbase9:45447] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:35,236 DEBUG [RS:0;jenkins-hbase9:45447] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:35,236 INFO [RS:0;jenkins-hbase9:45447] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:35,236 INFO [RS:0;jenkins-hbase9:45447] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:35,259 DEBUG [jenkins-hbase9:35943] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:35,259 DEBUG [jenkins-hbase9:35943] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:35,261 DEBUG [jenkins-hbase9:35943] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:35,261 DEBUG [jenkins-hbase9:35943] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:35,261 DEBUG [jenkins-hbase9:35943] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:35,261 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43889,1676160214933, state=OPENING 2023-02-12 00:03:35,262 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:35,263 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,266 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:35,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43889,1676160214933}] 2023-02-12 00:03:35,420 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:35,421 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:35,422 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52376, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:35,426 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:35,426 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:35,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43889%2C1676160214933.meta, suffix=.meta, logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,43889,1676160214933, archiveDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs, maxLogs=32 2023-02-12 00:03:35,446 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK] 2023-02-12 00:03:35,446 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK] 2023-02-12 00:03:35,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,43889,1676160214933/jenkins-hbase9.apache.org%2C43889%2C1676160214933.meta.1676160215427.meta 2023-02-12 00:03:35,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK], DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK]] 2023-02-12 00:03:35,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:35,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:35,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:35,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:35,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:35,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:35,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:35,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:35,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/info 2023-02-12 00:03:35,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/info 2023-02-12 00:03:35,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:35,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:35,453 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:35,453 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:35,453 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:35,454 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,454 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:35,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/table 2023-02-12 00:03:35,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/table 2023-02-12 00:03:35,455 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:35,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740 2023-02-12 00:03:35,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740 2023-02-12 00:03:35,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:35,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:35,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64828286, jitterRate=-0.0339832603931427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:35,460 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160215449Writing region info on filesystem at 1676160215449Initializing all the Stores at 1676160215450 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160215450Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160215451 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160215451Cleaning up temporary data from old regions at 1676160215457 (+6 ms)Cleaning up detritus from prior splits at 1676160215458 (+1 ms)Running coprocessor post-open hooks at 1676160215460 (+2 ms)Region opened successfully at 1676160215460 2023-02-12 00:03:35,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160215420 2023-02-12 00:03:35,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:35,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:35,464 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43889,1676160214933, state=OPEN 2023-02-12 00:03:35,467 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:35,467 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:35,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:35,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43889,1676160214933 in 203 msec 2023-02-12 00:03:35,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:35,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-12 00:03:35,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 399 msec 2023-02-12 00:03:35,470 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160214954, completionTime=-1 2023-02-12 00:03:35,470 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:35,471 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:35,473 DEBUG [hconnection-0x39ca07f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:35,474 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52382, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:35,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:35,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160275475 2023-02-12 00:03:35,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160335475 2023-02-12 00:03:35,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35943,1676160214855-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35943,1676160214855-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35943,1676160214855-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35943, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:35,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:35,482 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:35,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:35,483 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:35,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:35,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:35,485 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/hbase/namespace/f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,486 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/hbase/namespace/f915581135ccfb0da6810fac32433178 empty. 2023-02-12 00:03:35,486 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/hbase/namespace/f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:35,495 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:35,496 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f915581135ccfb0da6810fac32433178, NAME => 'hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f915581135ccfb0da6810fac32433178, disabling compactions & flushes 2023-02-12 00:03:35,508 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. after waiting 0 ms 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,508 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,508 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f915581135ccfb0da6810fac32433178: Waiting for close lock at 1676160215508Disabling compacts and flushes for region at 1676160215508Disabling writes for close at 1676160215508Writing region close event to WAL at 1676160215508Closed at 1676160215508 2023-02-12 00:03:35,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:35,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160215511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160215511"}]},"ts":"1676160215511"} 2023-02-12 00:03:35,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:35,514 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:35,514 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160215514"}]},"ts":"1676160215514"} 2023-02-12 00:03:35,515 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:35,519 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:35,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:35,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:35,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:35,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f915581135ccfb0da6810fac32433178, ASSIGN}] 2023-02-12 00:03:35,523 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f915581135ccfb0da6810fac32433178, ASSIGN 2023-02-12 00:03:35,523 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f915581135ccfb0da6810fac32433178, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45447,1676160214906; forceNewPlan=false, retain=false 2023-02-12 00:03:35,673 INFO [jenkins-hbase9:35943] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:35,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f915581135ccfb0da6810fac32433178, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160215674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160215674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160215674"}]},"ts":"1676160215674"} 2023-02-12 00:03:35,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f915581135ccfb0da6810fac32433178, server=jenkins-hbase9.apache.org,45447,1676160214906}] 2023-02-12 00:03:35,829 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,829 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:35,830 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55776, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:35,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45447%2C1676160214906, suffix=, logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,45447,1676160214906, archiveDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs, maxLogs=32 2023-02-12 00:03:35,848 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK] 2023-02-12 00:03:35,848 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK] 2023-02-12 00:03:35,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,45447,1676160214906/jenkins-hbase9.apache.org%2C45447%2C1676160214906.1676160215835 2023-02-12 00:03:35,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK], DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK]] 2023-02-12 00:03:35,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f915581135ccfb0da6810fac32433178, NAME => 'hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:35,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,854 INFO [StoreOpener-f915581135ccfb0da6810fac32433178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,855 DEBUG [StoreOpener-f915581135ccfb0da6810fac32433178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/info 2023-02-12 00:03:35,855 DEBUG [StoreOpener-f915581135ccfb0da6810fac32433178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/info 2023-02-12 00:03:35,855 INFO [StoreOpener-f915581135ccfb0da6810fac32433178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f915581135ccfb0da6810fac32433178 columnFamilyName info 2023-02-12 00:03:35,855 INFO [StoreOpener-f915581135ccfb0da6810fac32433178-1] regionserver.HStore(310): Store=f915581135ccfb0da6810fac32433178/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:35,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f915581135ccfb0da6810fac32433178 2023-02-12 00:03:35,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:35,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f915581135ccfb0da6810fac32433178; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71811230, jitterRate=0.07007071375846863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:35,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f915581135ccfb0da6810fac32433178: Running coprocessor pre-open hook at 1676160215853Writing region info on filesystem at 1676160215853Initializing all the Stores at 1676160215854 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160215854Cleaning up temporary data from old regions at 1676160215857 (+3 ms)Cleaning up detritus from prior splits at 1676160215857Running coprocessor post-open hooks at 1676160215860 (+3 ms)Region opened successfully at 1676160215860 2023-02-12 00:03:35,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178., pid=6, masterSystemTime=1676160215829 2023-02-12 00:03:35,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,864 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:35,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f915581135ccfb0da6810fac32433178, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:35,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160215864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160215864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160215864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160215864"}]},"ts":"1676160215864"} 2023-02-12 00:03:35,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:35,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f915581135ccfb0da6810fac32433178, server=jenkins-hbase9.apache.org,45447,1676160214906 in 190 msec 2023-02-12 00:03:35,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:35,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f915581135ccfb0da6810fac32433178, ASSIGN in 347 msec 2023-02-12 00:03:35,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:35,869 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160215869"}]},"ts":"1676160215869"} 2023-02-12 00:03:35,870 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:35,872 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:35,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-12 00:03:35,883 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:35,884 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:35,885 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:35,886 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:35,888 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:35,890 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:35,897 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:35,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 00:03:35,913 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:35,919 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:35,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 00:03:35,927 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:35,929 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:35,929 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.969sec 2023-02-12 00:03:35,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:35,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:35,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:35,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35943,1676160214855-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:35,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35943,1676160214855-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:35,931 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:35,954 DEBUG [Listener at localhost/44385] zookeeper.ReadOnlyZKClient(139): Connect 0x388b80bd to 127.0.0.1:55426 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:35,960 DEBUG [Listener at localhost/44385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78d9a039, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:35,961 DEBUG [hconnection-0x2e8aa535-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:35,963 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52384, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:35,964 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:35,964 DEBUG [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:35,968 DEBUG [Listener at localhost/44385] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:35,969 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:35,970 INFO [Listener at localhost/44385] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 00:03:35,970 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-12 00:03:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.2.10:34468 deadline: 1676160275970, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-12 00:03:35,971 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-12 00:03:35,973 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:35,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:35,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:35,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-12 00:03:35,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:35,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:35,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:35,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 empty. 2023-02-12 00:03:35,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:35,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 00:03:35,985 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:35,986 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 458118b84e3039083ecd7bd59a9a4223, NAME => 'testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 458118b84e3039083ecd7bd59a9a4223, disabling compactions & flushes 2023-02-12 00:03:35,991 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. after waiting 0 ms 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:35,991 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:35,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 458118b84e3039083ecd7bd59a9a4223: Waiting for close lock at 1676160215991Disabling compacts and flushes for region at 1676160215991Disabling writes for close at 1676160215991Writing region close event to WAL at 1676160215991Closed at 1676160215991 2023-02-12 00:03:35,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:35,993 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676160215993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160215993"}]},"ts":"1676160215993"} 2023-02-12 00:03:35,995 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:35,995 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:35,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160215995"}]},"ts":"1676160215995"} 2023-02-12 00:03:35,996 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-12 00:03:36,002 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:36,003 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:36,003 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:36,003 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:36,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, ASSIGN}] 2023-02-12 00:03:36,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, ASSIGN 2023-02-12 00:03:36,005 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43889,1676160214933; forceNewPlan=false, retain=false 2023-02-12 00:03:36,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:36,156 INFO [jenkins-hbase9:35943] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:36,156 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=458118b84e3039083ecd7bd59a9a4223, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676160216156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160216156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160216156"}]},"ts":"1676160216156"} 2023-02-12 00:03:36,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 458118b84e3039083ecd7bd59a9a4223, server=jenkins-hbase9.apache.org,43889,1676160214933}] 2023-02-12 00:03:36,231 INFO [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43889%2C1676160214933, suffix=, logDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,43889,1676160214933, archiveDir=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs, maxLogs=32 2023-02-12 00:03:36,243 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK] 2023-02-12 00:03:36,243 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK] 2023-02-12 00:03:36,245 INFO [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/WALs/jenkins-hbase9.apache.org,43889,1676160214933/jenkins-hbase9.apache.org%2C43889%2C1676160214933.1676160216231 2023-02-12 00:03:36,245 DEBUG [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39975,DS-72b0358e-dfbb-4501-ab32-0b9385d26552,DISK], DatanodeInfoWithStorage[127.0.0.1:41129,DS-d12c593b-717b-4856-9d95-93a20ab4902f,DISK]] 2023-02-12 00:03:36,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:36,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 458118b84e3039083ecd7bd59a9a4223, NAME => 'testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:36,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:36,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,313 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,314 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1 2023-02-12 00:03:36,314 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1 2023-02-12 00:03:36,315 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 458118b84e3039083ecd7bd59a9a4223 columnFamilyName f1 2023-02-12 00:03:36,315 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(310): Store=458118b84e3039083ecd7bd59a9a4223/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:36,315 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,316 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2 2023-02-12 00:03:36,316 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2 2023-02-12 00:03:36,316 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 458118b84e3039083ecd7bd59a9a4223 columnFamilyName f2 2023-02-12 00:03:36,317 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(310): Store=458118b84e3039083ecd7bd59a9a4223/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:36,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:36,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:36,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:36,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 458118b84e3039083ecd7bd59a9a4223; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65652515, jitterRate=-0.02170129120349884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:36,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 458118b84e3039083ecd7bd59a9a4223: Running coprocessor pre-open hook at 1676160216312Writing region info on filesystem at 1676160216312Initializing all the Stores at 1676160216313 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160216313Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160216313Cleaning up temporary data from old regions at 1676160216318 (+5 ms)Cleaning up detritus from prior splits at 1676160216318Running coprocessor post-open hooks at 1676160216321 (+3 ms)Region opened successfully at 1676160216321 2023-02-12 00:03:36,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223., pid=12, masterSystemTime=1676160216309 2023-02-12 00:03:36,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,323 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=458118b84e3039083ecd7bd59a9a4223, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,323 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676160216323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160216323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160216323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160216323"}]},"ts":"1676160216323"} 2023-02-12 00:03:36,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 00:03:36,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 458118b84e3039083ecd7bd59a9a4223, server=jenkins-hbase9.apache.org,43889,1676160214933 in 168 msec 2023-02-12 00:03:36,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 00:03:36,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, ASSIGN in 323 msec 2023-02-12 00:03:36,327 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:36,327 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160216327"}]},"ts":"1676160216327"} 2023-02-12 00:03:36,328 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-12 00:03:36,330 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:36,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 357 msec 2023-02-12 00:03:36,434 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:36,434 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 00:03:36,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:36,580 INFO [Listener at localhost/44385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-12 00:03:36,581 DEBUG [Listener at localhost/44385] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-12 00:03:36,581 INFO [Listener at localhost/44385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:36,584 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-12 00:03:36,584 INFO [Listener at localhost/44385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:36,585 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-12 00:03:36,585 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:36,618 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43889] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,706 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:36,707 INFO [Listener at localhost/44385] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:36,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 00:03:36,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160216708 (current time:1676160216708). 2023-02-12 00:03:36,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:36,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] zookeeper.ReadOnlyZKClient(139): Connect 0x3900e6d7 to 127.0.0.1:55426 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:36,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76ef0d29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:36,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:36,713 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:36,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3900e6d7 to 127.0.0.1:55426 2023-02-12 00:03:36,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:36,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:36,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 00:03:36,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 00:03:36,717 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 00:03:36,718 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676160816718 2023-02-12 00:03:36,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 00:03:36,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,719 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:36,719 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:36,720 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 00:03:36,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 00:03:36,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-12 00:03:36,721 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 00:03:36,722 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676160816722 2023-02-12 00:03:36,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,731 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 00:03:36,731 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:36,732 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 00:03:36,732 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 00:03:36,732 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,732 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,733 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,733 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:36,733 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:36,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:36,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:36,734 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,734 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 00:03:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,735 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 00:03:36,735 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 00:03:36,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,739 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 00:03:36,739 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:36,739 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 00:03:36,739 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:36,739 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:36,740 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:36,740 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 00:03:36,740 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43889,1676160214933' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 00:03:36,740 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 00:03:36,740 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45447,1676160214906' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 00:03:36,743 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,743 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:36,744 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:36,744 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,744 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:36,744 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,744 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43889,1676160214933' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@607f58e5[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:36,745 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 00:03:36,745 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,746 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,746 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,747 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:36,747 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,45447,1676160214906' in zk 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 00:03:36,747 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:36,747 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,747 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. started... 2023-02-12 00:03:36,747 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 458118b84e3039083ecd7bd59a9a4223 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 00:03:36,748 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:36,748 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:36,748 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 00:03:36,762 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f1/942488f550f14d4595f224ba2d12cd7e 2023-02-12 00:03:36,779 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f2/ef95026711924070bfc286d52c05e75e 2023-02-12 00:03:36,782 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f1/942488f550f14d4595f224ba2d12cd7e as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e 2023-02-12 00:03:36,786 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:36,786 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f2/ef95026711924070bfc286d52c05e75e as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e 2023-02-12 00:03:36,790 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:36,791 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 458118b84e3039083ecd7bd59a9a4223 in 44ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:36,791 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-12 00:03:36,791 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 458118b84e3039083ecd7bd59a9a4223: 2023-02-12 00:03:36,791 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,791 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:36,791 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e] hfiles 2023-02-12 00:03:36,792 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,792 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e] hfiles 2023-02-12 00:03:36,792 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,796 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. completed. 2023-02-12 00:03:36,796 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:36,796 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 00:03:36,797 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 00:03:36,797 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,797 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 00:03:36,797 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,43889,1676160214933' in zk 2023-02-12 00:03:36,800 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,800 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:36,800 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:36,800 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 00:03:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,43889,1676160214933': 2023-02-12 00:03:36,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43889,1676160214933' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:36,802 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 00:03:36,802 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:36,802 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:36,802 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,802 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:36,804 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:36,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,804 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:36,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:36,805 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,805 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,806 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:36,807 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,813 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,813 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:36,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:36,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:36,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:36,820 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:36,821 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:36,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-12 00:03:36,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,842 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:36,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676160216718Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676160216814 (+96 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676160216814Writing data manifest for testWithMockedMapReduceSingleRegion at 1676160216817 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676160216823 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676160216842 (+19 ms) 2023-02-12 00:03:36,844 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 00:03:36,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 125 msec 2023-02-12 00:03:37,021 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:37,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 00:03:37,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:37,023 INFO [Listener at localhost/44385] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:37,026 INFO [Listener at localhost/44385] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:37,031 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:37,062 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43889] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,140 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:37,145 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:37,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,147 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 00:03:37,147 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:37,148 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 00:03:37,148 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 00:03:37,148 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,148 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,149 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:37,149 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:37,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:37,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:37,149 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:37,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,150 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,151 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 00:03:37,151 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45447,1676160214906' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 00:03:37,152 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:37,152 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,153 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. started... 2023-02-12 00:03:37,153 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 458118b84e3039083ecd7bd59a9a4223 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 00:03:37,154 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,154 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,154 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:37,173 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f1/08ddbecc1bce42e4a216551a6aa1c648 2023-02-12 00:03:37,194 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f2/993a94d255024c7fbda1e008f5755f30 2023-02-12 00:03:37,198 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f1/08ddbecc1bce42e4a216551a6aa1c648 as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/08ddbecc1bce42e4a216551a6aa1c648 2023-02-12 00:03:37,202 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/08ddbecc1bce42e4a216551a6aa1c648, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:37,202 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/.tmp/f2/993a94d255024c7fbda1e008f5755f30 as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/993a94d255024c7fbda1e008f5755f30 2023-02-12 00:03:37,206 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/993a94d255024c7fbda1e008f5755f30, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:37,207 INFO [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 458118b84e3039083ecd7bd59a9a4223 in 54ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:37,208 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 458118b84e3039083ecd7bd59a9a4223: 2023-02-12 00:03:37,208 DEBUG [rs(jenkins-hbase9.apache.org,43889,1676160214933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,208 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 00:03:37,208 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 00:03:37,208 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,208 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 00:03:37,208 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43889,1676160214933' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 00:03:37,210 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:37,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43889,1676160214933' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 00:03:37,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6440c032[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:37,212 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 00:03:37,212 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,215 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:37,215 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 00:03:37,215 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,216 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,43889,1676160214933' in zk 2023-02-12 00:03:37,215 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 00:03:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,45447,1676160214906' in zk 2023-02-12 00:03:37,217 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,43889,1676160214933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 00:03:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,45447,1676160214906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 00:03:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,43889,1676160214933': 2023-02-12 00:03:37,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43889,1676160214933' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:37,220 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 00:03:37,221 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:37,221 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:37,221 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,221 INFO [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:37,222 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,222 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:37,223 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,223 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,224 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:37,225 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,228 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,229 DEBUG [(jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:37,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-12 00:03:37,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:37,229 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:37,230 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,330 DEBUG [Listener at localhost/44385] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:37,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:37,335 INFO [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676160216708 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:37,336 DEBUG [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224/data/default/testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,336 INFO [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(239): region to add: 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,336 INFO [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(585): clone region=458118b84e3039083ecd7bd59a9a4223 as 458118b84e3039083ecd7bd59a9a4223 in snapshot testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,337 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 458118b84e3039083ecd7bd59a9a4223, NAME => 'testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224 2023-02-12 00:03:37,343 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:37,343 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 942488f550f14d4595f224ba2d12cd7e from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,345 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ef95026711924070bfc286d52c05e75e from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,346 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 458118b84e3039083ecd7bd59a9a4223, disabling compactions & flushes 2023-02-12 00:03:37,346 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,346 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,346 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. after waiting 0 ms 2023-02-12 00:03:37,346 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,346 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,346 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 458118b84e3039083ecd7bd59a9a4223: Waiting for close lock at 1676160217346Disabling compacts and flushes for region at 1676160217346Disabling writes for close at 1676160217346Writing region close event to WAL at 1676160217346Closed at 1676160217346 2023-02-12 00:03:37,347 INFO [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676160216708 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:37,347 DEBUG [Listener at localhost/44385] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224 2023-02-12 00:03:37,347 DEBUG [Listener at localhost/44385] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224 2023-02-12 00:03:37,347 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:37,348 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:37,348 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-12 00:03:37,348 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |----------458118b84e3039083ecd7bd59a9a4223/ 2023-02-12 00:03:37,348 DEBUG [Listener at localhost/44385] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:37,348 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:37,349 DEBUG [Listener at localhost/44385] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=458118b84e3039083ecd7bd59a9a4223-942488f550f14d4595f224ba2d12cd7e 2023-02-12 00:03:37,349 DEBUG [Listener at localhost/44385] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:37,349 DEBUG [Listener at localhost/44385] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=458118b84e3039083ecd7bd59a9a4223-ef95026711924070bfc286d52c05e75e 2023-02-12 00:03:37,352 INFO [Listener at localhost/44385] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 00:03:37,355 DEBUG [Listener at localhost/44385] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:37,355 INFO [Listener at localhost/44385] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:37,355 DEBUG [Listener at localhost/44385] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:37,357 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,358 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1 2023-02-12 00:03:37,358 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 458118b84e3039083ecd7bd59a9a4223 columnFamilyName f1 2023-02-12 00:03:37,362 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(539): loaded hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/testWithMockedMapReduceSingleRegion=458118b84e3039083ecd7bd59a9a4223-942488f550f14d4595f224ba2d12cd7e 2023-02-12 00:03:37,362 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(310): Store=458118b84e3039083ecd7bd59a9a4223/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:37,362 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,363 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2 2023-02-12 00:03:37,363 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 458118b84e3039083ecd7bd59a9a4223 columnFamilyName f2 2023-02-12 00:03:37,366 DEBUG [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(539): loaded hdfs://localhost:35029/user/jenkins/test-data/269ffc76-7fc9-6bab-4ce3-13a09c7a9905/testWithMockedMapReduceSingleRegion/eafe29c1-4147-4934-b0c2-c6a9eb24c224/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/testWithMockedMapReduceSingleRegion=458118b84e3039083ecd7bd59a9a4223-ef95026711924070bfc286d52c05e75e 2023-02-12 00:03:37,367 INFO [StoreOpener-458118b84e3039083ecd7bd59a9a4223-1] regionserver.HStore(310): Store=458118b84e3039083ecd7bd59a9a4223/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:37,367 DEBUG [Listener at localhost/44385] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:37,367 INFO [Listener at localhost/44385] regionserver.HRegion(1071): Opened 458118b84e3039083ecd7bd59a9a4223; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68593906, jitterRate=0.02212885022163391}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:37,367 DEBUG [Listener at localhost/44385] regionserver.HRegion(964): Region open journal for 458118b84e3039083ecd7bd59a9a4223: Writing region info on filesystem at 1676160217355Initializing all the Stores at 1676160217356 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160217356Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160217356Region opened successfully at 1676160217367 (+11 ms) 2023-02-12 00:03:37,412 DEBUG [Listener at localhost/44385] regionserver.HRegion(1603): Closing 458118b84e3039083ecd7bd59a9a4223, disabling compactions & flushes 2023-02-12 00:03:37,412 INFO [Listener at localhost/44385] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,412 DEBUG [Listener at localhost/44385] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,412 DEBUG [Listener at localhost/44385] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. after waiting 0 ms 2023-02-12 00:03:37,412 DEBUG [Listener at localhost/44385] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,413 INFO [Listener at localhost/44385] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,413 DEBUG [Listener at localhost/44385] regionserver.HRegion(1557): Region close journal for 458118b84e3039083ecd7bd59a9a4223: Waiting for close lock at 1676160217412Disabling compacts and flushes for region at 1676160217412Disabling writes for close at 1676160217412Writing region close event to WAL at 1676160217413 (+1 ms)Closed at 1676160217413 2023-02-12 00:03:37,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-12 00:03:37,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,420 INFO [Listener at localhost/44385] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:37,423 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160217423"}]},"ts":"1676160217423"} 2023-02-12 00:03:37,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-12 00:03:37,426 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-12 00:03:37,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, UNASSIGN}] 2023-02-12 00:03:37,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, UNASSIGN 2023-02-12 00:03:37,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=458118b84e3039083ecd7bd59a9a4223, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,429 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676160217428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160217428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160217428"}]},"ts":"1676160217428"} 2023-02-12 00:03:37,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 458118b84e3039083ecd7bd59a9a4223, server=jenkins-hbase9.apache.org,43889,1676160214933}] 2023-02-12 00:03:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:37,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 458118b84e3039083ecd7bd59a9a4223, disabling compactions & flushes 2023-02-12 00:03:37,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. after waiting 0 ms 2023-02-12 00:03:37,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:37,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223. 2023-02-12 00:03:37,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 458118b84e3039083ecd7bd59a9a4223: Waiting for close lock at 1676160217581Running coprocessor pre-close hooks at 1676160217581Disabling compacts and flushes for region at 1676160217581Disabling writes for close at 1676160217582 (+1 ms)Writing region close event to WAL at 1676160217582Running coprocessor post-close hooks at 1676160217585 (+3 ms)Closed at 1676160217585 2023-02-12 00:03:37,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=458118b84e3039083ecd7bd59a9a4223, regionState=CLOSED 2023-02-12 00:03:37,587 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676160217587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160217587"}]},"ts":"1676160217587"} 2023-02-12 00:03:37,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 00:03:37,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 458118b84e3039083ecd7bd59a9a4223, server=jenkins-hbase9.apache.org,43889,1676160214933 in 158 msec 2023-02-12 00:03:37,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 00:03:37,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=458118b84e3039083ecd7bd59a9a4223, UNASSIGN in 162 msec 2023-02-12 00:03:37,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160217591"}]},"ts":"1676160217591"} 2023-02-12 00:03:37,592 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-12 00:03:37,593 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-12 00:03:37,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-12 00:03:37,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:37,726 INFO [Listener at localhost/44385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-12 00:03:37,727 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,729 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:37,732 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,734 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1, FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2, FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/recovered.edits] 2023-02-12 00:03:37,737 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/08ddbecc1bce42e4a216551a6aa1c648 to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/archive/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/08ddbecc1bce42e4a216551a6aa1c648 2023-02-12 00:03:37,738 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/archive/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f1/942488f550f14d4595f224ba2d12cd7e 2023-02-12 00:03:37,740 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/993a94d255024c7fbda1e008f5755f30 to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/archive/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/993a94d255024c7fbda1e008f5755f30 2023-02-12 00:03:37,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/archive/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/f2/ef95026711924070bfc286d52c05e75e 2023-02-12 00:03:37,742 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/recovered.edits/12.seqid to hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/archive/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223/recovered.edits/12.seqid 2023-02-12 00:03:37,743 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/.tmp/data/default/testWithMockedMapReduceSingleRegion/458118b84e3039083ecd7bd59a9a4223 2023-02-12 00:03:37,743 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 00:03:37,744 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,746 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-12 00:03:37,747 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-12 00:03:37,748 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,748 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-12 00:03:37,748 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160217748"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:37,749 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 00:03:37,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 458118b84e3039083ecd7bd59a9a4223, NAME => 'testWithMockedMapReduceSingleRegion,,1676160215973.458118b84e3039083ecd7bd59a9a4223.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 00:03:37,749 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-12 00:03:37,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160217749"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:37,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-12 00:03:37,752 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 00:03:37,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 25 msec 2023-02-12 00:03:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35943] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:37,831 INFO [Listener at localhost/44385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-12 00:03:37,832 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:37,832 INFO [Listener at localhost/44385] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:37,832 DEBUG [Listener at localhost/44385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x388b80bd to 127.0.0.1:55426 2023-02-12 00:03:37,832 DEBUG [Listener at localhost/44385] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:37,832 DEBUG [Listener at localhost/44385] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:37,832 DEBUG [Listener at localhost/44385] util.JVMClusterUtil(257): Found active master hash=993051968, stopped=false 2023-02-12 00:03:37,832 INFO [Listener at localhost/44385] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:37,835 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:37,835 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:37,835 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:37,835 INFO [Listener at localhost/44385] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:37,835 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:37,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:37,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:37,837 DEBUG [Listener at localhost/44385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x529fc8cf to 127.0.0.1:55426 2023-02-12 00:03:37,837 DEBUG [Listener at localhost/44385] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:37,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:37,837 INFO [Listener at localhost/44385] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45447,1676160214906' ***** 2023-02-12 00:03:37,837 INFO [Listener at localhost/44385] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:37,837 INFO [Listener at localhost/44385] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,43889,1676160214933' ***** 2023-02-12 00:03:37,837 INFO [Listener at localhost/44385] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:37,837 INFO [RS:0;jenkins-hbase9:45447] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:37,838 INFO [RS:0;jenkins-hbase9:45447] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:37,838 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:37,838 INFO [RS:0;jenkins-hbase9:45447] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:37,838 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(3304): Received CLOSE for f915581135ccfb0da6810fac32433178 2023-02-12 00:03:37,838 INFO [RS:1;jenkins-hbase9:43889] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:37,839 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:37,839 DEBUG [RS:0;jenkins-hbase9:45447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02c879d6 to 127.0.0.1:55426 2023-02-12 00:03:37,839 DEBUG [RS:0;jenkins-hbase9:45447] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f915581135ccfb0da6810fac32433178, disabling compactions & flushes 2023-02-12 00:03:37,839 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:37,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:37,839 INFO [RS:1;jenkins-hbase9:43889] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. after waiting 0 ms 2023-02-12 00:03:37,839 INFO [RS:1;jenkins-hbase9:43889] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:37,839 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:37,840 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:37,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:37,840 DEBUG [RS:1;jenkins-hbase9:43889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f7e6ae8 to 127.0.0.1:55426 2023-02-12 00:03:37,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing f915581135ccfb0da6810fac32433178 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:37,840 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1479): Online Regions={f915581135ccfb0da6810fac32433178=hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178.} 2023-02-12 00:03:37,840 DEBUG [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1505): Waiting on f915581135ccfb0da6810fac32433178 2023-02-12 00:03:37,840 DEBUG [RS:1;jenkins-hbase9:43889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:37,840 INFO [RS:1;jenkins-hbase9:43889] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:37,840 INFO [RS:1;jenkins-hbase9:43889] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:37,840 INFO [RS:1;jenkins-hbase9:43889] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:37,840 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:37,842 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:37,842 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 00:03:37,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:37,842 DEBUG [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 00:03:37,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:37,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:37,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:37,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:37,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-12 00:03:37,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/.tmp/info/bc3e8c4ed179437481f791d52dcb5d8a 2023-02-12 00:03:37,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/info/05cffee44fc6430d85f09526e9f417ba 2023-02-12 00:03:37,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05cffee44fc6430d85f09526e9f417ba 2023-02-12 00:03:37,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/.tmp/info/bc3e8c4ed179437481f791d52dcb5d8a as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/info/bc3e8c4ed179437481f791d52dcb5d8a 2023-02-12 00:03:37,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/info/bc3e8c4ed179437481f791d52dcb5d8a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:37,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f915581135ccfb0da6810fac32433178 in 19ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:37,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/rep_barrier/f740e60d09554f21a97af2cf294e13eb 2023-02-12 00:03:37,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/namespace/f915581135ccfb0da6810fac32433178/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:37,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:37,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f915581135ccfb0da6810fac32433178: Waiting for close lock at 1676160217839Running coprocessor pre-close hooks at 1676160217839Disabling compacts and flushes for region at 1676160217839Disabling writes for close at 1676160217839Obtaining lock to block concurrent updates at 1676160217840 (+1 ms)Preparing flush snapshotting stores in f915581135ccfb0da6810fac32433178 at 1676160217840Finished memstore snapshotting hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160217840Flushing stores of hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. at 1676160217842 (+2 ms)Flushing f915581135ccfb0da6810fac32433178/info: creating writer at 1676160217842Flushing f915581135ccfb0da6810fac32433178/info: appending metadata at 1676160217844 (+2 ms)Flushing f915581135ccfb0da6810fac32433178/info: closing flushed file at 1676160217844Flushing f915581135ccfb0da6810fac32433178/info: reopening flushed file at 1676160217855 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f915581135ccfb0da6810fac32433178 in 19ms, sequenceid=6, compaction requested=false at 1676160217860 (+5 ms)Writing region close event to WAL at 1676160217860Running coprocessor post-close hooks at 1676160217863 (+3 ms)Closed at 1676160217863 2023-02-12 00:03:37,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160215482.f915581135ccfb0da6810fac32433178. 2023-02-12 00:03:37,864 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f740e60d09554f21a97af2cf294e13eb 2023-02-12 00:03:37,872 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/table/ac2670d99c53435cbd38b4ee8364c41d 2023-02-12 00:03:37,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac2670d99c53435cbd38b4ee8364c41d 2023-02-12 00:03:37,876 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/info/05cffee44fc6430d85f09526e9f417ba as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/info/05cffee44fc6430d85f09526e9f417ba 2023-02-12 00:03:37,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05cffee44fc6430d85f09526e9f417ba 2023-02-12 00:03:37,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/info/05cffee44fc6430d85f09526e9f417ba, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 00:03:37,880 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/rep_barrier/f740e60d09554f21a97af2cf294e13eb as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/rep_barrier/f740e60d09554f21a97af2cf294e13eb 2023-02-12 00:03:37,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f740e60d09554f21a97af2cf294e13eb 2023-02-12 00:03:37,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/rep_barrier/f740e60d09554f21a97af2cf294e13eb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 00:03:37,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/.tmp/table/ac2670d99c53435cbd38b4ee8364c41d as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/table/ac2670d99c53435cbd38b4ee8364c41d 2023-02-12 00:03:37,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac2670d99c53435cbd38b4ee8364c41d 2023-02-12 00:03:37,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/table/ac2670d99c53435cbd38b4ee8364c41d, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 00:03:37,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-12 00:03:37,894 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 00:03:37,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:37,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:37,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160217842Running coprocessor pre-close hooks at 1676160217842Disabling compacts and flushes for region at 1676160217842Disabling writes for close at 1676160217842Obtaining lock to block concurrent updates at 1676160217843 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676160217843Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676160217843Flushing stores of hbase:meta,,1.1588230740 at 1676160217843Flushing 1588230740/info: creating writer at 1676160217843Flushing 1588230740/info: appending metadata at 1676160217845 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676160217845Flushing 1588230740/rep_barrier: creating writer at 1676160217855 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160217856 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160217856Flushing 1588230740/table: creating writer at 1676160217865 (+9 ms)Flushing 1588230740/table: appending metadata at 1676160217866 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676160217866Flushing 1588230740/info: reopening flushed file at 1676160217876 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160217881 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676160217885 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false at 1676160217891 (+6 ms)Writing region close event to WAL at 1676160217892 (+1 ms)Running coprocessor post-close hooks at 1676160217895 (+3 ms)Closed at 1676160217895 2023-02-12 00:03:37,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:37,909 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:37,915 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:38,040 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45447,1676160214906; all regions closed. 2023-02-12 00:03:38,042 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,43889,1676160214933; all regions closed. 2023-02-12 00:03:38,044 DEBUG [RS:0;jenkins-hbase9:45447] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs 2023-02-12 00:03:38,044 INFO [RS:0;jenkins-hbase9:45447] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45447%2C1676160214906:(num 1676160215835) 2023-02-12 00:03:38,044 DEBUG [RS:0;jenkins-hbase9:45447] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:38,044 INFO [RS:0;jenkins-hbase9:45447] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:38,044 INFO [RS:0;jenkins-hbase9:45447] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:38,045 INFO [RS:0;jenkins-hbase9:45447] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:38,045 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:38,045 INFO [RS:0;jenkins-hbase9:45447] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:38,045 INFO [RS:0;jenkins-hbase9:45447] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:38,046 INFO [RS:0;jenkins-hbase9:45447] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45447 2023-02-12 00:03:38,047 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:38,047 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:38,047 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:38,047 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45447,1676160214906 2023-02-12 00:03:38,047 DEBUG [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs 2023-02-12 00:03:38,047 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:38,047 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27864372 rejected from java.util.concurrent.ThreadPoolExecutor@23b9c35a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,048 INFO [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43889%2C1676160214933.meta:.meta(num 1676160215427) 2023-02-12 00:03:38,048 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45447,1676160214906] 2023-02-12 00:03:38,048 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45447,1676160214906; numProcessing=1 2023-02-12 00:03:38,050 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45447,1676160214906 already deleted, retry=false 2023-02-12 00:03:38,050 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45447,1676160214906 expired; onlineServers=1 2023-02-12 00:03:38,052 DEBUG [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/oldWALs 2023-02-12 00:03:38,052 INFO [RS:1;jenkins-hbase9:43889] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43889%2C1676160214933:(num 1676160216231) 2023-02-12 00:03:38,052 DEBUG [RS:1;jenkins-hbase9:43889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:38,052 INFO [RS:1;jenkins-hbase9:43889] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:38,052 INFO [RS:1;jenkins-hbase9:43889] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:38,052 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:38,053 INFO [RS:1;jenkins-hbase9:43889] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43889 2023-02-12 00:03:38,057 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43889,1676160214933 2023-02-12 00:03:38,057 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:38,057 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4743936a rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,058 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43889,1676160214933] 2023-02-12 00:03:38,058 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43889,1676160214933; numProcessing=2 2023-02-12 00:03:38,059 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43889,1676160214933 already deleted, retry=false 2023-02-12 00:03:38,059 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43889,1676160214933 expired; onlineServers=0 2023-02-12 00:03:38,059 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35943,1676160214855' ***** 2023-02-12 00:03:38,059 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:38,060 DEBUG [M:0;jenkins-hbase9:35943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f0f56fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:38,060 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35943,1676160214855 2023-02-12 00:03:38,060 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35943,1676160214855; all regions closed. 2023-02-12 00:03:38,060 DEBUG [M:0;jenkins-hbase9:35943] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:38,060 DEBUG [M:0;jenkins-hbase9:35943] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:38,060 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:38,060 DEBUG [M:0;jenkins-hbase9:35943] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:38,060 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160215076] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160215076,5,FailOnTimeoutGroup] 2023-02-12 00:03:38,060 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160215076] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160215076,5,FailOnTimeoutGroup] 2023-02-12 00:03:38,060 INFO [M:0;jenkins-hbase9:35943] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:38,061 INFO [M:0;jenkins-hbase9:35943] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:38,061 INFO [M:0;jenkins-hbase9:35943] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:38,062 DEBUG [M:0;jenkins-hbase9:35943] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:38,062 INFO [M:0;jenkins-hbase9:35943] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:38,062 ERROR [M:0;jenkins-hbase9:35943] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:38,062 INFO [M:0;jenkins-hbase9:35943] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:38,062 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:38,062 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:38,062 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:38,063 DEBUG [M:0;jenkins-hbase9:35943] zookeeper.ZKUtil(398): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:38,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:38,063 WARN [M:0;jenkins-hbase9:35943] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:38,063 INFO [M:0;jenkins-hbase9:35943] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:38,063 INFO [M:0;jenkins-hbase9:35943] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:38,063 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:38,063 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:38,063 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:38,063 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:38,063 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:38,064 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-12 00:03:38,073 INFO [M:0;jenkins-hbase9:35943] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c192cc069be42918568aef8ffe17c7f 2023-02-12 00:03:38,076 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c192cc069be42918568aef8ffe17c7f as hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c192cc069be42918568aef8ffe17c7f 2023-02-12 00:03:38,080 INFO [M:0;jenkins-hbase9:35943] regionserver.HStore(1080): Added hdfs://localhost:35029/user/jenkins/test-data/67f2c42d-6925-4aba-544b-0c0927ec4877/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c192cc069be42918568aef8ffe17c7f, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 00:03:38,080 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 00:03:38,081 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:38,081 DEBUG [M:0;jenkins-hbase9:35943] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160218063Disabling compacts and flushes for region at 1676160218063Disabling writes for close at 1676160218063Obtaining lock to block concurrent updates at 1676160218064 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160218064Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57497, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1676160218064Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160218065 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160218065Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160218067 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160218067Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160218077 (+10 ms)Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676160218080 (+3 ms)Writing region close event to WAL at 1676160218081 (+1 ms)Closed at 1676160218081 2023-02-12 00:03:38,083 INFO [M:0;jenkins-hbase9:35943] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:38,083 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:38,084 INFO [M:0;jenkins-hbase9:35943] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35943 2023-02-12 00:03:38,087 DEBUG [M:0;jenkins-hbase9:35943] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35943,1676160214855 already deleted, retry=false 2023-02-12 00:03:38,336 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,337 INFO [M:0;jenkins-hbase9:35943] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35943,1676160214855; zookeeper connection closed. 2023-02-12 00:03:38,337 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@bcab7bc rejected from java.util.concurrent.ThreadPoolExecutor@ff5321d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,338 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): master:35943-0x10045d807210000, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,338 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25de4385 rejected from java.util.concurrent.ThreadPoolExecutor@ff5321d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,437 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,437 INFO [RS:1;jenkins-hbase9:43889] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,43889,1676160214933; zookeeper connection closed. 2023-02-12 00:03:38,437 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cb19890 rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,439 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@373ebb2a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@373ebb2a 2023-02-12 00:03:38,439 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:43889-0x10045d807210002, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,439 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1417c1dc rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,537 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,537 INFO [RS:0;jenkins-hbase9:45447] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45447,1676160214906; zookeeper connection closed. 2023-02-12 00:03:38,537 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@421fbd4c rejected from java.util.concurrent.ThreadPoolExecutor@23b9c35a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,537 DEBUG [Listener at localhost/44385-EventThread] zookeeper.ZKWatcher(600): regionserver:45447-0x10045d807210001, quorum=127.0.0.1:55426, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:38,537 ERROR [Listener at localhost/44385-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ad94115 rejected from java.util.concurrent.ThreadPoolExecutor@23b9c35a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:38,537 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@373f2e47] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@373f2e47 2023-02-12 00:03:38,538 INFO [Listener at localhost/44385] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:38,539 WARN [Listener at localhost/44385] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:38,543 INFO [Listener at localhost/44385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:38,647 WARN [BP-502587545-172.31.2.10-1676160214261 heartbeating to localhost/127.0.0.1:35029] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:38,647 WARN [BP-502587545-172.31.2.10-1676160214261 heartbeating to localhost/127.0.0.1:35029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-502587545-172.31.2.10-1676160214261 (Datanode Uuid f9d61a40-5047-4158-baf1-fd7c9eae4564) service to localhost/127.0.0.1:35029 2023-02-12 00:03:38,648 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/dfs/data/data3/current/BP-502587545-172.31.2.10-1676160214261] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:38,648 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/dfs/data/data4/current/BP-502587545-172.31.2.10-1676160214261] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:38,649 WARN [Listener at localhost/44385] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:38,652 INFO [Listener at localhost/44385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:38,756 WARN [BP-502587545-172.31.2.10-1676160214261 heartbeating to localhost/127.0.0.1:35029] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:38,757 WARN [BP-502587545-172.31.2.10-1676160214261 heartbeating to localhost/127.0.0.1:35029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-502587545-172.31.2.10-1676160214261 (Datanode Uuid 5bb8d1fa-8334-4720-968d-19cd77628ec9) service to localhost/127.0.0.1:35029 2023-02-12 00:03:38,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/dfs/data/data1/current/BP-502587545-172.31.2.10-1676160214261] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:38,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/cluster_fd34e1f1-4370-641d-8bd5-6fec9e37500e/dfs/data/data2/current/BP-502587545-172.31.2.10-1676160214261] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:38,768 INFO [Listener at localhost/44385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:38,882 INFO [Listener at localhost/44385] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:38,903 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:38,915 INFO [Listener at localhost/44385] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 230) Potentially hanging thread: Listener at localhost/44385.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:35029 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:35029 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/44385 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:35029 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:35029 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:35029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:35029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,35943,1676160214855)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=656 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 231), ProcessCount=167 (was 167), AvailableMemoryMB=9361 (was 9371) 2023-02-12 00:03:38,927 INFO [Listener at localhost/44385] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=656, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=167, AvailableMemoryMB=9361 2023-02-12 00:03:38,940 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.log.dir so I do NOT create it in target/test-data/f429c569-f096-2f56-f876-85d0f52c9785 2023-02-12 00:03:38,940 WARN [Listener at localhost/44385] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:38,940 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.tmp.dir so I do NOT create it in target/test-data/f429c569-f096-2f56-f876-85d0f52c9785 2023-02-12 00:03:38,940 WARN [Listener at localhost/44385] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9a9c423-cbff-59dd-4133-18e818b0d383/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:38,941 DEBUG [Listener at localhost/44385] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036, deleteOnExit=true 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/test.cache.data in system properties and HBase conf 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:38,941 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:38,942 DEBUG [Listener at localhost/44385] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:38,942 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:38,943 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:38,944 INFO [Listener at localhost/44385] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:38,949 WARN [Listener at localhost/44385] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:38,949 WARN [Listener at localhost/44385] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:38,987 WARN [Listener at localhost/44385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:38,989 INFO [Listener at localhost/44385] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:38,997 INFO [Listener at localhost/44385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/java.io.tmpdir/Jetty_localhost_43451_hdfs____s075i3/webapp 2023-02-12 00:03:39,103 INFO [Listener at localhost/44385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43451 2023-02-12 00:03:39,108 WARN [Listener at localhost/44385] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:39,108 WARN [Listener at localhost/44385] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:39,151 WARN [Listener at localhost/40863] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:39,162 WARN [Listener at localhost/40863] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:39,164 WARN [Listener at localhost/40863] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:39,165 INFO [Listener at localhost/40863] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:39,171 INFO [Listener at localhost/40863] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/java.io.tmpdir/Jetty_localhost_34577_datanode____.auijwl/webapp 2023-02-12 00:03:39,273 INFO [Listener at localhost/40863] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34577 2023-02-12 00:03:39,286 WARN [Listener at localhost/44199] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:39,298 WARN [Listener at localhost/44199] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:39,300 WARN [Listener at localhost/44199] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:39,301 INFO [Listener at localhost/44199] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:39,306 INFO [Listener at localhost/44199] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/java.io.tmpdir/Jetty_localhost_39265_datanode____w9lx9u/webapp 2023-02-12 00:03:39,449 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6de9960ed35bdab: Processing first storage report for DS-438c420a-0b85-40f1-8b79-36096f717659 from datanode a50cfee5-f233-44e5-a240-8428109facce 2023-02-12 00:03:39,449 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6de9960ed35bdab: from storage DS-438c420a-0b85-40f1-8b79-36096f717659 node DatanodeRegistration(127.0.0.1:35345, datanodeUuid=a50cfee5-f233-44e5-a240-8428109facce, infoPort=38689, infoSecurePort=0, ipcPort=44199, storageInfo=lv=-57;cid=testClusterID;nsid=1430731210;c=1676160218951), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:39,449 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6de9960ed35bdab: Processing first storage report for DS-9389aa73-1307-456d-9dba-5dab671836a5 from datanode a50cfee5-f233-44e5-a240-8428109facce 2023-02-12 00:03:39,449 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6de9960ed35bdab: from storage DS-9389aa73-1307-456d-9dba-5dab671836a5 node DatanodeRegistration(127.0.0.1:35345, datanodeUuid=a50cfee5-f233-44e5-a240-8428109facce, infoPort=38689, infoSecurePort=0, ipcPort=44199, storageInfo=lv=-57;cid=testClusterID;nsid=1430731210;c=1676160218951), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:39,460 INFO [Listener at localhost/44199] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39265 2023-02-12 00:03:39,470 WARN [Listener at localhost/34047] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:39,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47306fd077a2443c: Processing first storage report for DS-de757860-3f60-4e34-9ec6-12ce88c79665 from datanode 134f77a9-3962-436a-ab38-6995d3c1b377 2023-02-12 00:03:39,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47306fd077a2443c: from storage DS-de757860-3f60-4e34-9ec6-12ce88c79665 node DatanodeRegistration(127.0.0.1:40921, datanodeUuid=134f77a9-3962-436a-ab38-6995d3c1b377, infoPort=45419, infoSecurePort=0, ipcPort=34047, storageInfo=lv=-57;cid=testClusterID;nsid=1430731210;c=1676160218951), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:39,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47306fd077a2443c: Processing first storage report for DS-216f60f6-69da-4b07-a727-5cefe6d42b0b from datanode 134f77a9-3962-436a-ab38-6995d3c1b377 2023-02-12 00:03:39,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47306fd077a2443c: from storage DS-216f60f6-69da-4b07-a727-5cefe6d42b0b node DatanodeRegistration(127.0.0.1:40921, datanodeUuid=134f77a9-3962-436a-ab38-6995d3c1b377, infoPort=45419, infoSecurePort=0, ipcPort=34047, storageInfo=lv=-57;cid=testClusterID;nsid=1430731210;c=1676160218951), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:39,685 DEBUG [Listener at localhost/34047] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785 2023-02-12 00:03:39,688 INFO [Listener at localhost/34047] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/zookeeper_0, clientPort=58153, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:39,689 INFO [Listener at localhost/34047] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58153 2023-02-12 00:03:39,689 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,690 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,704 INFO [Listener at localhost/34047] util.FSUtils(479): Created version file at hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7 with version=8 2023-02-12 00:03:39,704 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,705 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,706 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40863/user/jenkins/test-data/75b7aefa-a3fc-6139-ceaa-0069cb122846/hbase-staging 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:39,709 INFO [Listener at localhost/34047] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:39,710 INFO [Listener at localhost/34047] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44817 2023-02-12 00:03:39,711 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,711 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,712 INFO [Listener at localhost/34047] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44817 connecting to ZooKeeper ensemble=127.0.0.1:58153 2023-02-12 00:03:39,720 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:448170x0, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:39,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44817-0x10045d81a150000 connected 2023-02-12 00:03:39,738 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:39,739 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:39,739 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:39,740 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-12 00:03:39,740 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44817 2023-02-12 00:03:39,740 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44817 2023-02-12 00:03:39,740 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-12 00:03:39,741 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44817 2023-02-12 00:03:39,741 INFO [Listener at localhost/34047] master.HMaster(439): hbase.rootdir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7, hbase.cluster.distributed=false 2023-02-12 00:03:39,758 INFO [Listener at localhost/34047] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:39,758 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,758 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,759 INFO [Listener at localhost/34047] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:39,759 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,759 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:39,759 INFO [Listener at localhost/34047] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:39,760 INFO [Listener at localhost/34047] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41051 2023-02-12 00:03:39,760 INFO [Listener at localhost/34047] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:39,761 DEBUG [Listener at localhost/34047] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:39,761 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,762 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,763 INFO [Listener at localhost/34047] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41051 connecting to ZooKeeper ensemble=127.0.0.1:58153 2023-02-12 00:03:39,765 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:410510x0, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:39,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41051-0x10045d81a150001 connected 2023-02-12 00:03:39,766 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:39,767 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:39,767 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:39,768 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-12 00:03:39,768 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41051 2023-02-12 00:03:39,768 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41051 2023-02-12 00:03:39,771 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-12 00:03:39,771 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-12 00:03:39,781 INFO [Listener at localhost/34047] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:39,781 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,781 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,781 INFO [Listener at localhost/34047] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:39,782 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:39,782 INFO [Listener at localhost/34047] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:39,782 INFO [Listener at localhost/34047] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:39,782 INFO [Listener at localhost/34047] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37959 2023-02-12 00:03:39,783 INFO [Listener at localhost/34047] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:39,783 DEBUG [Listener at localhost/34047] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:39,783 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,784 INFO [Listener at localhost/34047] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,785 INFO [Listener at localhost/34047] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37959 connecting to ZooKeeper ensemble=127.0.0.1:58153 2023-02-12 00:03:39,787 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:379590x0, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:39,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37959-0x10045d81a150002 connected 2023-02-12 00:03:39,788 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:39,789 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:39,789 DEBUG [Listener at localhost/34047] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:39,789 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37959 2023-02-12 00:03:39,789 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37959 2023-02-12 00:03:39,790 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37959 2023-02-12 00:03:39,793 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37959 2023-02-12 00:03:39,793 DEBUG [Listener at localhost/34047] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37959 2023-02-12 00:03:39,796 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:39,797 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:39,798 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:39,800 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:39,800 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:39,800 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:39,800 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:39,801 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:39,803 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,44817,1676160219708 from backup master directory 2023-02-12 00:03:39,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:39,804 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:39,804 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:39,805 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:39,805 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:39,818 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/hbase.id with ID: dc760817-ddd8-4be0-b4ea-6f60647a36ff 2023-02-12 00:03:39,832 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:39,835 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:39,849 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x39f85675 to 127.0.0.1:58153 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:39,853 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a116808, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:39,854 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:39,854 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:39,855 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:39,856 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store-tmp 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:40,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:40,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:40,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160220270Disabling compacts and flushes for region at 1676160220270Disabling writes for close at 1676160220270Writing region close event to WAL at 1676160220270Closed at 1676160220270 2023-02-12 00:03:40,271 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/WALs/jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:40,273 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44817%2C1676160219708, suffix=, logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/WALs/jenkins-hbase9.apache.org,44817,1676160219708, archiveDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:40,285 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK] 2023-02-12 00:03:40,285 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK] 2023-02-12 00:03:40,287 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/WALs/jenkins-hbase9.apache.org,44817,1676160219708/jenkins-hbase9.apache.org%2C44817%2C1676160219708.1676160220273 2023-02-12 00:03:40,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK]] 2023-02-12 00:03:40,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:40,288 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:40,288 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,288 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,289 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,290 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:40,290 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:40,291 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,293 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:40,295 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:40,295 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62277997, jitterRate=-0.07198552787303925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:40,295 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160220288Initializing all the Stores at 1676160220288Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160220288Cleaning up temporary data from old regions at 1676160220292 (+4 ms)Cleaning up detritus from prior splits at 1676160220292Region opened successfully at 1676160220295 (+3 ms) 2023-02-12 00:03:40,295 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:40,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:40,298 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:40,298 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:40,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:40,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:40,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:40,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:40,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:40,311 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:40,311 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:40,312 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:40,312 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:40,314 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:40,314 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:40,314 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:40,314 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:40,314 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,44817,1676160219708, sessionid=0x10045d81a150000, setting cluster-up flag (Was=false) 2023-02-12 00:03:40,319 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:40,323 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:40,324 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:40,330 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:40,333 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:40,333 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:40,334 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/.tmp 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:40,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160250336 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:40,337 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:40,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,337 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:40,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:40,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:40,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:40,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:40,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:40,339 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160220339,5,FailOnTimeoutGroup] 2023-02-12 00:03:40,339 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:40,342 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160220339,5,FailOnTimeoutGroup] 2023-02-12 00:03:40,343 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,343 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:40,343 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,343 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,348 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:40,348 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:40,348 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7 2023-02-12 00:03:40,356 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:40,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:40,358 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/info 2023-02-12 00:03:40,358 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:40,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:40,359 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:40,360 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:40,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:40,361 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/table 2023-02-12 00:03:40,361 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:40,362 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,362 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740 2023-02-12 00:03:40,362 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740 2023-02-12 00:03:40,364 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:40,365 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:40,366 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:40,367 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69044077, jitterRate=0.028836920857429504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:40,367 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160220356Initializing all the Stores at 1676160220356Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160220356Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160220356Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160220357 (+1 ms)Cleaning up temporary data from old regions at 1676160220363 (+6 ms)Cleaning up detritus from prior splits at 1676160220364 (+1 ms)Region opened successfully at 1676160220367 (+3 ms) 2023-02-12 00:03:40,367 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:40,367 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:40,367 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:40,367 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:40,367 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:40,368 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:40,368 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160220367Disabling compacts and flushes for region at 1676160220367Disabling writes for close at 1676160220367Writing region close event to WAL at 1676160220368 (+1 ms)Closed at 1676160220368 2023-02-12 00:03:40,368 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:40,368 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:40,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:40,370 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:40,371 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:40,397 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(952): ClusterId : dc760817-ddd8-4be0-b4ea-6f60647a36ff 2023-02-12 00:03:40,397 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(952): ClusterId : dc760817-ddd8-4be0-b4ea-6f60647a36ff 2023-02-12 00:03:40,397 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:40,397 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:40,400 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:40,400 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:40,400 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:40,400 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:40,402 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:40,402 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:40,403 DEBUG [RS:1;jenkins-hbase9:37959] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddcc517 to 127.0.0.1:58153 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:40,403 DEBUG [RS:0;jenkins-hbase9:41051] zookeeper.ReadOnlyZKClient(139): Connect 0x2a21227e to 127.0.0.1:58153 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:40,407 DEBUG [RS:0;jenkins-hbase9:41051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e6c94a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:40,407 DEBUG [RS:1;jenkins-hbase9:37959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731b24dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:40,408 DEBUG [RS:1;jenkins-hbase9:37959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7724ae67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:40,408 DEBUG [RS:0;jenkins-hbase9:41051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d9490e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:40,416 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:37959 2023-02-12 00:03:40,416 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41051 2023-02-12 00:03:40,416 INFO [RS:1;jenkins-hbase9:37959] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:40,416 INFO [RS:1;jenkins-hbase9:37959] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:40,416 INFO [RS:0;jenkins-hbase9:41051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:40,416 INFO [RS:0;jenkins-hbase9:41051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:40,416 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:40,416 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:40,417 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,44817,1676160219708 with isa=jenkins-hbase9.apache.org/172.31.2.10:37959, startcode=1676160219781 2023-02-12 00:03:40,417 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,44817,1676160219708 with isa=jenkins-hbase9.apache.org/172.31.2.10:41051, startcode=1676160219758 2023-02-12 00:03:40,417 DEBUG [RS:0;jenkins-hbase9:41051] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:40,417 DEBUG [RS:1;jenkins-hbase9:37959] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:40,419 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42995, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:40,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44817] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,420 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43611, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:40,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,421 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7 2023-02-12 00:03:40,421 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40863 2023-02-12 00:03:40,421 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:40,422 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7 2023-02-12 00:03:40,422 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40863 2023-02-12 00:03:40,422 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:40,423 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:40,428 DEBUG [RS:1;jenkins-hbase9:37959] zookeeper.ZKUtil(162): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,428 WARN [RS:1;jenkins-hbase9:37959] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:40,428 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37959,1676160219781] 2023-02-12 00:03:40,428 INFO [RS:1;jenkins-hbase9:37959] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:40,428 DEBUG [RS:0;jenkins-hbase9:41051] zookeeper.ZKUtil(162): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,428 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,428 WARN [RS:0;jenkins-hbase9:41051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:40,428 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41051,1676160219758] 2023-02-12 00:03:40,428 INFO [RS:0;jenkins-hbase9:41051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:40,428 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,432 DEBUG [RS:1;jenkins-hbase9:37959] zookeeper.ZKUtil(162): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,432 DEBUG [RS:0;jenkins-hbase9:41051] zookeeper.ZKUtil(162): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,432 DEBUG [RS:1;jenkins-hbase9:37959] zookeeper.ZKUtil(162): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,433 DEBUG [RS:0;jenkins-hbase9:41051] zookeeper.ZKUtil(162): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,433 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:40,433 INFO [RS:1;jenkins-hbase9:37959] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:40,433 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:40,434 INFO [RS:0;jenkins-hbase9:41051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:40,435 INFO [RS:1;jenkins-hbase9:37959] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:40,435 INFO [RS:1;jenkins-hbase9:37959] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:40,435 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,435 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:40,436 INFO [RS:0;jenkins-hbase9:41051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:40,436 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,437 INFO [RS:0;jenkins-hbase9:41051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,437 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:40,437 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,438 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,438 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,438 DEBUG [RS:1;jenkins-hbase9:37959] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,439 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:40,440 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,440 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,440 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,440 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,440 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,440 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,440 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,440 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,441 DEBUG [RS:0;jenkins-hbase9:41051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:40,442 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,442 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,442 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,452 INFO [RS:0;jenkins-hbase9:41051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:40,453 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41051,1676160219758-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,453 INFO [RS:1;jenkins-hbase9:37959] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:40,453 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37959,1676160219781-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,463 INFO [RS:0;jenkins-hbase9:41051] regionserver.Replication(203): jenkins-hbase9.apache.org,41051,1676160219758 started 2023-02-12 00:03:40,463 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41051,1676160219758, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41051, sessionid=0x10045d81a150001 2023-02-12 00:03:40,464 INFO [RS:1;jenkins-hbase9:37959] regionserver.Replication(203): jenkins-hbase9.apache.org,37959,1676160219781 started 2023-02-12 00:03:40,464 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:40,464 DEBUG [RS:0;jenkins-hbase9:41051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,464 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41051,1676160219758' 2023-02-12 00:03:40,464 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:40,464 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37959,1676160219781, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37959, sessionid=0x10045d81a150002 2023-02-12 00:03:40,464 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:40,464 DEBUG [RS:1;jenkins-hbase9:37959] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,464 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37959,1676160219781' 2023-02-12 00:03:40,464 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41051,1676160219758' 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37959,1676160219781' 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:40,465 DEBUG [RS:1;jenkins-hbase9:37959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:40,465 DEBUG [RS:0;jenkins-hbase9:41051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:40,465 INFO [RS:0;jenkins-hbase9:41051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:40,465 INFO [RS:0;jenkins-hbase9:41051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:40,466 DEBUG [RS:1;jenkins-hbase9:37959] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:40,466 INFO [RS:1;jenkins-hbase9:37959] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:40,466 INFO [RS:1;jenkins-hbase9:37959] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:40,521 DEBUG [jenkins-hbase9:44817] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:40,521 DEBUG [jenkins-hbase9:44817] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:40,523 DEBUG [jenkins-hbase9:44817] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:40,523 DEBUG [jenkins-hbase9:44817] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:40,523 DEBUG [jenkins-hbase9:44817] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:40,523 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37959,1676160219781, state=OPENING 2023-02-12 00:03:40,524 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:40,525 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:40,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37959,1676160219781}] 2023-02-12 00:03:40,526 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:40,680 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:40,680 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:40,682 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:40,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:40,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:40,687 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37959%2C1676160219781.meta, suffix=.meta, logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,37959,1676160219781, archiveDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs, maxLogs=32 2023-02-12 00:03:40,700 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK] 2023-02-12 00:03:40,701 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK] 2023-02-12 00:03:40,702 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,37959,1676160219781/jenkins-hbase9.apache.org%2C37959%2C1676160219781.meta.1676160220688.meta 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK], DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK]] 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:40,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:40,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:40,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:40,708 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/info 2023-02-12 00:03:40,708 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/info 2023-02-12 00:03:40,708 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:40,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:40,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:40,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:40,709 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:40,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:40,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/table 2023-02-12 00:03:40,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/table 2023-02-12 00:03:40,711 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:40,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:40,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740 2023-02-12 00:03:40,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740 2023-02-12 00:03:40,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:40,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:40,715 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71369387, jitterRate=0.0634867399930954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:40,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160220704Writing region info on filesystem at 1676160220704Initializing all the Stores at 1676160220704Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160220704Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160220707 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160220707Cleaning up temporary data from old regions at 1676160220713 (+6 ms)Cleaning up detritus from prior splits at 1676160220713Running coprocessor post-open hooks at 1676160220715 (+2 ms)Region opened successfully at 1676160220715 2023-02-12 00:03:40,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160220680 2023-02-12 00:03:40,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:40,720 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:40,720 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37959,1676160219781, state=OPEN 2023-02-12 00:03:40,721 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:40,721 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:40,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:40,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37959,1676160219781 in 195 msec 2023-02-12 00:03:40,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:40,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-12 00:03:40,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-12 00:03:40,725 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160219798, completionTime=-1 2023-02-12 00:03:40,725 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:40,725 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:40,727 DEBUG [hconnection-0x7bb23255-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:40,728 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:40,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:40,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160280730 2023-02-12 00:03:40,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160340730 2023-02-12 00:03:40,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 00:03:40,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44817,1676160219708-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44817,1676160219708-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44817,1676160219708-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:44817, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:40,740 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:40,740 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:40,740 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:40,741 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:40,741 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:40,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:40,743 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:40,744 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794 empty. 2023-02-12 00:03:40,744 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:40,744 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:40,752 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:40,753 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41f0ab726bbf5816895ee3287649c794, NAME => 'hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 41f0ab726bbf5816895ee3287649c794, disabling compactions & flushes 2023-02-12 00:03:40,758 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. after waiting 0 ms 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:40,758 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:40,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 41f0ab726bbf5816895ee3287649c794: Waiting for close lock at 1676160220758Disabling compacts and flushes for region at 1676160220758Disabling writes for close at 1676160220758Writing region close event to WAL at 1676160220758Closed at 1676160220758 2023-02-12 00:03:40,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:40,761 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160220760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160220760"}]},"ts":"1676160220760"} 2023-02-12 00:03:40,762 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:40,762 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:40,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160220762"}]},"ts":"1676160220762"} 2023-02-12 00:03:40,763 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:40,766 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:40,766 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:40,766 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:40,766 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:40,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41f0ab726bbf5816895ee3287649c794, ASSIGN}] 2023-02-12 00:03:40,769 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41f0ab726bbf5816895ee3287649c794, ASSIGN 2023-02-12 00:03:40,769 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=41f0ab726bbf5816895ee3287649c794, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41051,1676160219758; forceNewPlan=false, retain=false 2023-02-12 00:03:40,919 INFO [jenkins-hbase9:44817] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:40,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41f0ab726bbf5816895ee3287649c794, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:40,920 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160220920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160220920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160220920"}]},"ts":"1676160220920"} 2023-02-12 00:03:40,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 41f0ab726bbf5816895ee3287649c794, server=jenkins-hbase9.apache.org,41051,1676160219758}] 2023-02-12 00:03:40,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:41,074 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:41,074 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:41,076 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:41,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:41,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41051%2C1676160219758, suffix=, logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,41051,1676160219758, archiveDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs, maxLogs=32 2023-02-12 00:03:41,099 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK] 2023-02-12 00:03:41,099 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK] 2023-02-12 00:03:41,101 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,41051,1676160219758/jenkins-hbase9.apache.org%2C41051%2C1676160219758.1676160221082 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK]] 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41f0ab726bbf5816895ee3287649c794, NAME => 'hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,102 INFO [StoreOpener-41f0ab726bbf5816895ee3287649c794-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,103 DEBUG [StoreOpener-41f0ab726bbf5816895ee3287649c794-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/info 2023-02-12 00:03:41,103 DEBUG [StoreOpener-41f0ab726bbf5816895ee3287649c794-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/info 2023-02-12 00:03:41,103 INFO [StoreOpener-41f0ab726bbf5816895ee3287649c794-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41f0ab726bbf5816895ee3287649c794 columnFamilyName info 2023-02-12 00:03:41,104 INFO [StoreOpener-41f0ab726bbf5816895ee3287649c794-1] regionserver.HStore(310): Store=41f0ab726bbf5816895ee3287649c794/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:41,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:41,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:41,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 41f0ab726bbf5816895ee3287649c794; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59167422, jitterRate=-0.11833670735359192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:41,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 41f0ab726bbf5816895ee3287649c794: Running coprocessor pre-open hook at 1676160221101Writing region info on filesystem at 1676160221101Initializing all the Stores at 1676160221102 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160221102Cleaning up temporary data from old regions at 1676160221105 (+3 ms)Cleaning up detritus from prior splits at 1676160221106 (+1 ms)Running coprocessor post-open hooks at 1676160221109 (+3 ms)Region opened successfully at 1676160221109 2023-02-12 00:03:41,110 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794., pid=6, masterSystemTime=1676160221074 2023-02-12 00:03:41,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:41,113 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:41,114 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41f0ab726bbf5816895ee3287649c794, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:41,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160221114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160221114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160221114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160221114"}]},"ts":"1676160221114"} 2023-02-12 00:03:41,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:41,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 41f0ab726bbf5816895ee3287649c794, server=jenkins-hbase9.apache.org,41051,1676160219758 in 194 msec 2023-02-12 00:03:41,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:41,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=41f0ab726bbf5816895ee3287649c794, ASSIGN in 350 msec 2023-02-12 00:03:41,118 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:41,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160221118"}]},"ts":"1676160221118"} 2023-02-12 00:03:41,119 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:41,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:41,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-12 00:03:41,141 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:41,142 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:41,142 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:41,144 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:41,146 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:41,147 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:41,153 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:41,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 00:03:41,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:41,164 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:41,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 00:03:41,178 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:41,180 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.376sec 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44817,1676160219708-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:41,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44817,1676160219708-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:41,182 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:41,198 DEBUG [Listener at localhost/34047] zookeeper.ReadOnlyZKClient(139): Connect 0x19b0b39b to 127.0.0.1:58153 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:41,201 DEBUG [Listener at localhost/34047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@439f5824, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:41,202 DEBUG [hconnection-0x4cb52dbe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:41,204 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:41,205 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:41,205 DEBUG [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:41,207 DEBUG [Listener at localhost/34047] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:41,209 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39454, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:41,209 INFO [Listener at localhost/34047] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:41,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.2.10:39454 deadline: 1676160281209, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:41,210 INFO [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 00:03:41,212 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:41,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:41,214 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:41,214 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-12 00:03:41,215 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:41,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:41,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 empty. 2023-02-12 00:03:41,217 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,217 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 00:03:41,225 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:41,227 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96476f9b7536f95bf015bb33957a0af9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 96476f9b7536f95bf015bb33957a0af9, disabling compactions & flushes 2023-02-12 00:03:41,237 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. after waiting 0 ms 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,237 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,237 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 96476f9b7536f95bf015bb33957a0af9: Waiting for close lock at 1676160221237Disabling compacts and flushes for region at 1676160221237Disabling writes for close at 1676160221237Writing region close event to WAL at 1676160221237Closed at 1676160221237 2023-02-12 00:03:41,239 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:41,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676160221240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160221240"}]},"ts":"1676160221240"} 2023-02-12 00:03:41,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:41,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:41,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160221242"}]},"ts":"1676160221242"} 2023-02-12 00:03:41,243 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-12 00:03:41,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:41,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:41,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:41,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:41,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, ASSIGN}] 2023-02-12 00:03:41,250 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, ASSIGN 2023-02-12 00:03:41,251 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41051,1676160219758; forceNewPlan=false, retain=false 2023-02-12 00:03:41,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:41,401 INFO [jenkins-hbase9:44817] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:41,401 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=96476f9b7536f95bf015bb33957a0af9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:41,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676160221401"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160221401"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160221401"}]},"ts":"1676160221401"} 2023-02-12 00:03:41,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 96476f9b7536f95bf015bb33957a0af9, server=jenkins-hbase9.apache.org,41051,1676160219758}] 2023-02-12 00:03:41,467 INFO [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37959%2C1676160219781, suffix=, logDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,37959,1676160219781, archiveDir=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs, maxLogs=32 2023-02-12 00:03:41,480 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK] 2023-02-12 00:03:41,480 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK] 2023-02-12 00:03:41,482 INFO [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/WALs/jenkins-hbase9.apache.org,37959,1676160219781/jenkins-hbase9.apache.org%2C37959%2C1676160219781.1676160221468 2023-02-12 00:03:41,482 DEBUG [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40921,DS-de757860-3f60-4e34-9ec6-12ce88c79665,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-438c420a-0b85-40f1-8b79-36096f717659,DISK]] 2023-02-12 00:03:41,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:41,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 96476f9b7536f95bf015bb33957a0af9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,559 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,560 DEBUG [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1 2023-02-12 00:03:41,560 DEBUG [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1 2023-02-12 00:03:41,561 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96476f9b7536f95bf015bb33957a0af9 columnFamilyName f1 2023-02-12 00:03:41,561 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] regionserver.HStore(310): Store=96476f9b7536f95bf015bb33957a0af9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:41,561 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,562 DEBUG [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2 2023-02-12 00:03:41,562 DEBUG [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2 2023-02-12 00:03:41,562 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96476f9b7536f95bf015bb33957a0af9 columnFamilyName f2 2023-02-12 00:03:41,563 INFO [StoreOpener-96476f9b7536f95bf015bb33957a0af9-1] regionserver.HStore(310): Store=96476f9b7536f95bf015bb33957a0af9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:41,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:41,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:41,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:41,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 96476f9b7536f95bf015bb33957a0af9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59444049, jitterRate=-0.11421464383602142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:41,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 96476f9b7536f95bf015bb33957a0af9: Running coprocessor pre-open hook at 1676160221558Writing region info on filesystem at 1676160221558Initializing all the Stores at 1676160221559 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160221559Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160221559Cleaning up temporary data from old regions at 1676160221564 (+5 ms)Cleaning up detritus from prior splits at 1676160221564Running coprocessor post-open hooks at 1676160221568 (+4 ms)Region opened successfully at 1676160221568 2023-02-12 00:03:41,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9., pid=12, masterSystemTime=1676160221555 2023-02-12 00:03:41,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,570 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=96476f9b7536f95bf015bb33957a0af9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:41,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676160221570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160221570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160221570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160221570"}]},"ts":"1676160221570"} 2023-02-12 00:03:41,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 00:03:41,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 96476f9b7536f95bf015bb33957a0af9, server=jenkins-hbase9.apache.org,41051,1676160219758 in 169 msec 2023-02-12 00:03:41,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 00:03:41,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, ASSIGN in 325 msec 2023-02-12 00:03:41,575 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:41,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160221575"}]},"ts":"1676160221575"} 2023-02-12 00:03:41,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-12 00:03:41,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:41,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 366 msec 2023-02-12 00:03:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:41,820 INFO [Listener at localhost/34047] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-12 00:03:41,820 DEBUG [Listener at localhost/34047] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-12 00:03:41,820 INFO [Listener at localhost/34047] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:41,822 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-12 00:03:41,823 INFO [Listener at localhost/34047] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:41,823 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-12 00:03:41,823 INFO [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:41,851 DEBUG [hconnection-0x4cb52dbe-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:41,863 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:41,871 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:41,992 INFO [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:41,992 INFO [Listener at localhost/34047] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:41,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 00:03:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160221994 (current time:1676160221994). 2023-02-12 00:03:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] zookeeper.ReadOnlyZKClient(139): Connect 0x69e768b4 to 127.0.0.1:58153 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:41,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dc9d88c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:41,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:42,000 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69e768b4 to 127.0.0.1:58153 2023-02-12 00:03:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:42,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 00:03:42,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 00:03:42,005 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 00:03:42,006 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676160822006 2023-02-12 00:03:42,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 00:03:42,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,007 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:42,008 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:42,008 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 00:03:42,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 00:03:42,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-12 00:03:42,010 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 00:03:42,011 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676160822011 2023-02-12 00:03:42,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 00:03:42,023 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 00:03:42,023 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:42,024 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 00:03:42,024 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 00:03:42,025 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,025 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,026 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:42,026 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:42,026 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:42,027 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,027 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 00:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 00:03:42,028 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 00:03:42,028 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:42,029 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 00:03:42,029 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 00:03:42,029 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37959,1676160219781' joining acquired barrier for procedure (foo) in zk 2023-02-12 00:03:42,029 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 00:03:42,029 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:42,030 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 00:03:42,030 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 00:03:42,030 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41051,1676160219758' joining acquired barrier for procedure (foo) in zk 2023-02-12 00:03:42,033 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,034 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,034 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,034 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:42,034 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:42,034 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,034 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41051,1676160219758' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 00:03:42,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e8636a[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:42,036 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 00:03:42,036 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,038 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 00:03:42,038 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 00:03:42,038 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,37959,1676160219781' in zk 2023-02-12 00:03:42,038 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,038 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:42,038 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 00:03:42,039 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 00:03:42,039 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:42,039 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,039 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. started... 2023-02-12 00:03:42,039 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 96476f9b7536f95bf015bb33957a0af9 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 00:03:42,039 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 00:03:42,039 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,040 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 00:03:42,055 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f1/dc6dd4f28a854169b29d8a96c21e37c2 2023-02-12 00:03:42,075 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f2/7546833cd7214c3ca89d8e9c15a0681a 2023-02-12 00:03:42,079 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f1/dc6dd4f28a854169b29d8a96c21e37c2 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2 2023-02-12 00:03:42,084 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:42,087 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f2/7546833cd7214c3ca89d8e9c15a0681a as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a 2023-02-12 00:03:42,093 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:42,094 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 96476f9b7536f95bf015bb33957a0af9 in 55ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:42,094 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 96476f9b7536f95bf015bb33957a0af9: 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.' region-info for snapshot=foo 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2] hfiles 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2 for snapshot=foo 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a] hfiles 2023-02-12 00:03:42,095 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a for snapshot=foo 2023-02-12 00:03:42,106 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. completed. 2023-02-12 00:03:42,106 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,106 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 00:03:42,106 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 00:03:42,107 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,107 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 00:03:42,107 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,41051,1676160219758' in zk 2023-02-12 00:03:42,108 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:42,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 00:03:42,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:42,109 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:42,109 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:42,109 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 00:03:42,110 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,110 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 00:03:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,41051,1676160219758': 2023-02-12 00:03:42,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41051,1676160219758' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 00:03:42,114 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 00:03:42,114 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:42,114 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:42,114 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 00:03:42,114 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:42,116 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:42,116 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:42,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:42,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:42,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,117 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,118 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,119 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,120 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 00:03:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,127 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:42,127 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:42,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:42,127 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:42,127 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:42,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:42,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:42,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,128 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,129 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,129 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 00:03:42,129 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 00:03:42,129 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 00:03:42,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 00:03:42,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-12 00:03:42,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:42,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/.tmp/foo to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/foo 2023-02-12 00:03:42,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-12 00:03:42,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:42,187 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.hbase-snapshot/.tmp/foo 2023-02-12 00:03:42,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676160222006Consolidate snapshot: foo at 1676160222129 (+123 ms)Loading Region manifests for foo at 1676160222129Writing data manifest for foo at 1676160222132 (+3 ms)Verifying snapshot: foo at 1676160222152 (+20 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676160222187 (+35 ms) 2023-02-12 00:03:42,189 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 00:03:42,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 181 msec 2023-02-12 00:03:42,309 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:42,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 00:03:42,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:42,311 INFO [Listener at localhost/34047] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:42,315 INFO [Listener at localhost/34047] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:42,323 INFO [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:42,359 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,454 INFO [Listener at localhost/34047] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:42,459 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:42,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,461 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 00:03:42,461 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:42,462 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-12 00:03:42,462 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-12 00:03:42,463 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,463 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,465 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:42,465 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:42,465 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:42,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:42,466 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,466 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,468 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 00:03:42,468 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:42,468 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 00:03:42,468 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:42,469 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 00:03:42,470 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 00:03:42,470 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 00:03:42,470 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37959,1676160219781' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 00:03:42,470 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 00:03:42,470 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:42,470 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,470 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. started... 2023-02-12 00:03:42,470 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 96476f9b7536f95bf015bb33957a0af9 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 00:03:42,472 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,472 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,472 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:42,485 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f1/189436ae724c4e5aba72714ba1654e45 2023-02-12 00:03:42,504 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f2/be2cf8c3561d46578087d1748c33e7e7 2023-02-12 00:03:42,509 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f1/189436ae724c4e5aba72714ba1654e45 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/189436ae724c4e5aba72714ba1654e45 2023-02-12 00:03:42,512 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/189436ae724c4e5aba72714ba1654e45, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:42,513 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/.tmp/f2/be2cf8c3561d46578087d1748c33e7e7 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/be2cf8c3561d46578087d1748c33e7e7 2023-02-12 00:03:42,517 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/be2cf8c3561d46578087d1748c33e7e7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:42,518 INFO [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 96476f9b7536f95bf015bb33957a0af9 in 47ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:42,519 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 96476f9b7536f95bf015bb33957a0af9: 2023-02-12 00:03:42,519 DEBUG [rs(jenkins-hbase9.apache.org,41051,1676160219758)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 00:03:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 00:03:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 00:03:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41051,1676160219758' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 00:03:42,520 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,520 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:42,521 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,521 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41051,1676160219758' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-12 00:03:42,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7e72f[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:42,523 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-12 00:03:42,523 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,41051,1676160219758' in zk 2023-02-12 00:03:42,524 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,524 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,37959,1676160219781' in zk 2023-02-12 00:03:42,528 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 00:03:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,41051,1676160219758' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 00:03:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,528 DEBUG [member: 'jenkins-hbase9.apache.org,37959,1676160219781' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 00:03:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase9.apache.org,41051,1676160219758': 2023-02-12 00:03:42,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41051,1676160219758' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-12 00:03:42,531 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-12 00:03:42,531 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:42,531 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:42,531 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,531 INFO [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:42,533 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:42,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,533 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:42,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:42,534 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,536 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,536 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 00:03:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:42,539 DEBUG [(jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:42,539 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,540 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:42,640 DEBUG [Listener at localhost/34047] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:42,646 INFO [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676160221994 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:42,646 DEBUG [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40863/user/jenkins/test-data/75b7aefa-a3fc-6139-ceaa-0069cb122846/foo/588b5ef0-b209-40e1-bd23-385261017a38/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,646 INFO [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(239): region to add: 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:42,646 INFO [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(585): clone region=96476f9b7536f95bf015bb33957a0af9 as 96476f9b7536f95bf015bb33957a0af9 in snapshot foo 2023-02-12 00:03:42,647 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96476f9b7536f95bf015bb33957a0af9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40863/user/jenkins/test-data/75b7aefa-a3fc-6139-ceaa-0069cb122846/foo/588b5ef0-b209-40e1-bd23-385261017a38 2023-02-12 00:03:42,654 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:42,654 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dc6dd4f28a854169b29d8a96c21e37c2 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,656 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7546833cd7214c3ca89d8e9c15a0681a from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 96476f9b7536f95bf015bb33957a0af9, disabling compactions & flushes 2023-02-12 00:03:42,658 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. after waiting 0 ms 2023-02-12 00:03:42,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,658 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 96476f9b7536f95bf015bb33957a0af9: Waiting for close lock at 1676160222658Disabling compacts and flushes for region at 1676160222658Disabling writes for close at 1676160222658Writing region close event to WAL at 1676160222658Closed at 1676160222658 2023-02-12 00:03:42,660 INFO [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676160221994 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:42,660 DEBUG [Listener at localhost/34047] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40863/user/jenkins/test-data/75b7aefa-a3fc-6139-ceaa-0069cb122846/foo/588b5ef0-b209-40e1-bd23-385261017a38 2023-02-12 00:03:42,660 DEBUG [Listener at localhost/34047] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40863/user/jenkins/test-data/75b7aefa-a3fc-6139-ceaa-0069cb122846/foo/588b5ef0-b209-40e1-bd23-385261017a38 2023-02-12 00:03:42,660 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:42,661 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:42,661 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-12 00:03:42,661 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |----------96476f9b7536f95bf015bb33957a0af9/ 2023-02-12 00:03:42,664 DEBUG [Listener at localhost/34047] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:42,664 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:42,664 DEBUG [Listener at localhost/34047] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=96476f9b7536f95bf015bb33957a0af9-dc6dd4f28a854169b29d8a96c21e37c2 2023-02-12 00:03:42,664 DEBUG [Listener at localhost/34047] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:42,665 DEBUG [Listener at localhost/34047] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=96476f9b7536f95bf015bb33957a0af9-7546833cd7214c3ca89d8e9c15a0681a hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/189436ae724c4e5aba72714ba1654e45 hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2 hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/be2cf8c3561d46578087d1748c33e7e7 2023-02-12 00:03:42,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-12 00:03:42,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 00:03:42,674 INFO [Listener at localhost/34047] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160222682"}]},"ts":"1676160222682"} 2023-02-12 00:03:42,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:42,683 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-12 00:03:42,686 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-12 00:03:42,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, UNASSIGN}] 2023-02-12 00:03:42,688 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, UNASSIGN 2023-02-12 00:03:42,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=96476f9b7536f95bf015bb33957a0af9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:42,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676160222689"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160222689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160222689"}]},"ts":"1676160222689"} 2023-02-12 00:03:42,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 96476f9b7536f95bf015bb33957a0af9, server=jenkins-hbase9.apache.org,41051,1676160219758}] 2023-02-12 00:03:42,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:42,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 96476f9b7536f95bf015bb33957a0af9, disabling compactions & flushes 2023-02-12 00:03:42,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. after waiting 0 ms 2023-02-12 00:03:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:42,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9. 2023-02-12 00:03:42,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 96476f9b7536f95bf015bb33957a0af9: Waiting for close lock at 1676160222842Running coprocessor pre-close hooks at 1676160222842Disabling compacts and flushes for region at 1676160222842Disabling writes for close at 1676160222842Writing region close event to WAL at 1676160222843 (+1 ms)Running coprocessor post-close hooks at 1676160222846 (+3 ms)Closed at 1676160222846 2023-02-12 00:03:42,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:42,848 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=96476f9b7536f95bf015bb33957a0af9, regionState=CLOSED 2023-02-12 00:03:42,848 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676160222848"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160222848"}]},"ts":"1676160222848"} 2023-02-12 00:03:42,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 00:03:42,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 96476f9b7536f95bf015bb33957a0af9, server=jenkins-hbase9.apache.org,41051,1676160219758 in 159 msec 2023-02-12 00:03:42,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 00:03:42,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96476f9b7536f95bf015bb33957a0af9, UNASSIGN in 164 msec 2023-02-12 00:03:42,852 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160222852"}]},"ts":"1676160222852"} 2023-02-12 00:03:42,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-12 00:03:42,858 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-12 00:03:42,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 185 msec 2023-02-12 00:03:42,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:42,986 INFO [Listener at localhost/34047] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-12 00:03:42,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,991 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,991 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:42,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:42,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:42,996 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1, FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2, FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/recovered.edits] 2023-02-12 00:03:42,999 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/189436ae724c4e5aba72714ba1654e45 to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/189436ae724c4e5aba72714ba1654e45 2023-02-12 00:03:43,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2 to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f1/dc6dd4f28a854169b29d8a96c21e37c2 2023-02-12 00:03:43,003 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/7546833cd7214c3ca89d8e9c15a0681a 2023-02-12 00:03:43,004 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/be2cf8c3561d46578087d1748c33e7e7 to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/f2/be2cf8c3561d46578087d1748c33e7e7 2023-02-12 00:03:43,007 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/recovered.edits/12.seqid to hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9/recovered.edits/12.seqid 2023-02-12 00:03:43,007 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96476f9b7536f95bf015bb33957a0af9 2023-02-12 00:03:43,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 00:03:43,011 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:43,012 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-12 00:03:43,013 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-12 00:03:43,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:43,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-12 00:03:43,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160223019"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:43,020 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 00:03:43,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 96476f9b7536f95bf015bb33957a0af9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676160221212.96476f9b7536f95bf015bb33957a0af9.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 00:03:43,020 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-12 00:03:43,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160223020"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:43,022 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-12 00:03:43,023 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 00:03:43,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 36 msec 2023-02-12 00:03:43,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:43,093 INFO [Listener at localhost/34047] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-12 00:03:43,093 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:43,093 INFO [Listener at localhost/34047] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:43,099 DEBUG [Listener at localhost/34047] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19b0b39b to 127.0.0.1:58153 2023-02-12 00:03:43,099 DEBUG [Listener at localhost/34047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,099 DEBUG [Listener at localhost/34047] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:43,099 DEBUG [Listener at localhost/34047] util.JVMClusterUtil(257): Found active master hash=232567246, stopped=false 2023-02-12 00:03:43,099 INFO [Listener at localhost/34047] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:43,103 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:43,103 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:43,103 INFO [Listener at localhost/34047] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:43,103 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:43,103 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:43,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:43,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:43,106 DEBUG [Listener at localhost/34047] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39f85675 to 127.0.0.1:58153 2023-02-12 00:03:43,106 DEBUG [Listener at localhost/34047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,106 INFO [Listener at localhost/34047] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41051,1676160219758' ***** 2023-02-12 00:03:43,106 INFO [Listener at localhost/34047] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:43,106 INFO [Listener at localhost/34047] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37959,1676160219781' ***** 2023-02-12 00:03:43,106 INFO [Listener at localhost/34047] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:43,107 INFO [RS:0;jenkins-hbase9:41051] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:43,107 INFO [RS:0;jenkins-hbase9:41051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:43,107 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:43,107 INFO [RS:0;jenkins-hbase9:41051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:43,108 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(3304): Received CLOSE for 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:43,108 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:43,108 DEBUG [RS:0;jenkins-hbase9:41051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a21227e to 127.0.0.1:58153 2023-02-12 00:03:43,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:43,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 41f0ab726bbf5816895ee3287649c794, disabling compactions & flushes 2023-02-12 00:03:43,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:43,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:43,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. after waiting 0 ms 2023-02-12 00:03:43,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:43,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 41f0ab726bbf5816895ee3287649c794 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:43,108 DEBUG [RS:0;jenkins-hbase9:41051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,109 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:43,109 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1479): Online Regions={41f0ab726bbf5816895ee3287649c794=hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794.} 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:43,109 DEBUG [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1505): Waiting on 41f0ab726bbf5816895ee3287649c794 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:43,109 DEBUG [RS:1;jenkins-hbase9:37959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddcc517 to 127.0.0.1:58153 2023-02-12 00:03:43,109 DEBUG [RS:1;jenkins-hbase9:37959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:43,109 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:43,109 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 00:03:43,110 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 00:03:43,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:43,110 DEBUG [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 00:03:43,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:43,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:43,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:43,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:43,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-12 00:03:43,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/.tmp/info/18ac3a34c374427ca42047b15fae140d 2023-02-12 00:03:43,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/info/979271c748d742e0b487adcc6979da60 2023-02-12 00:03:43,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/.tmp/info/18ac3a34c374427ca42047b15fae140d as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/info/18ac3a34c374427ca42047b15fae140d 2023-02-12 00:03:43,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979271c748d742e0b487adcc6979da60 2023-02-12 00:03:43,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/info/18ac3a34c374427ca42047b15fae140d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:43,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 41f0ab726bbf5816895ee3287649c794 in 33ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:43,142 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:43,152 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:43,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/namespace/41f0ab726bbf5816895ee3287649c794/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:43,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:43,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 41f0ab726bbf5816895ee3287649c794: Waiting for close lock at 1676160223108Running coprocessor pre-close hooks at 1676160223108Disabling compacts and flushes for region at 1676160223108Disabling writes for close at 1676160223108Obtaining lock to block concurrent updates at 1676160223108Preparing flush snapshotting stores in 41f0ab726bbf5816895ee3287649c794 at 1676160223108Finished memstore snapshotting hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160223108Flushing stores of hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. at 1676160223109 (+1 ms)Flushing 41f0ab726bbf5816895ee3287649c794/info: creating writer at 1676160223109Flushing 41f0ab726bbf5816895ee3287649c794/info: appending metadata at 1676160223112 (+3 ms)Flushing 41f0ab726bbf5816895ee3287649c794/info: closing flushed file at 1676160223112Flushing 41f0ab726bbf5816895ee3287649c794/info: reopening flushed file at 1676160223136 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 41f0ab726bbf5816895ee3287649c794 in 33ms, sequenceid=6, compaction requested=false at 1676160223141 (+5 ms)Writing region close event to WAL at 1676160223152 (+11 ms)Running coprocessor post-close hooks at 1676160223168 (+16 ms)Closed at 1676160223168 2023-02-12 00:03:43,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160220740.41f0ab726bbf5816895ee3287649c794. 2023-02-12 00:03:43,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/rep_barrier/bed6af3896764be9b519a3caad42c331 2023-02-12 00:03:43,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bed6af3896764be9b519a3caad42c331 2023-02-12 00:03:43,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/table/b205e45c3d794f9ba412e1dfb31b026f 2023-02-12 00:03:43,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b205e45c3d794f9ba412e1dfb31b026f 2023-02-12 00:03:43,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/info/979271c748d742e0b487adcc6979da60 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/info/979271c748d742e0b487adcc6979da60 2023-02-12 00:03:43,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979271c748d742e0b487adcc6979da60 2023-02-12 00:03:43,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/info/979271c748d742e0b487adcc6979da60, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 00:03:43,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/rep_barrier/bed6af3896764be9b519a3caad42c331 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/rep_barrier/bed6af3896764be9b519a3caad42c331 2023-02-12 00:03:43,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bed6af3896764be9b519a3caad42c331 2023-02-12 00:03:43,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/rep_barrier/bed6af3896764be9b519a3caad42c331, entries=1, sequenceid=21, filesize=5.1 K 2023-02-12 00:03:43,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/.tmp/table/b205e45c3d794f9ba412e1dfb31b026f as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/table/b205e45c3d794f9ba412e1dfb31b026f 2023-02-12 00:03:43,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b205e45c3d794f9ba412e1dfb31b026f 2023-02-12 00:03:43,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/table/b205e45c3d794f9ba412e1dfb31b026f, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 00:03:43,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 92ms, sequenceid=21, compaction requested=false 2023-02-12 00:03:43,205 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 00:03:43,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:43,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:43,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160223110Running coprocessor pre-close hooks at 1676160223110Disabling compacts and flushes for region at 1676160223110Disabling writes for close at 1676160223110Obtaining lock to block concurrent updates at 1676160223110Preparing flush snapshotting stores in 1588230740 at 1676160223110Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676160223111 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676160223111Flushing 1588230740/info: creating writer at 1676160223111Flushing 1588230740/info: appending metadata at 1676160223113 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676160223113Flushing 1588230740/rep_barrier: creating writer at 1676160223138 (+25 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160223140 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160223140Flushing 1588230740/table: creating writer at 1676160223174 (+34 ms)Flushing 1588230740/table: appending metadata at 1676160223175 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676160223176 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1676160223189 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160223193 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676160223197 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 92ms, sequenceid=21, compaction requested=false at 1676160223202 (+5 ms)Writing region close event to WAL at 1676160223203 (+1 ms)Running coprocessor post-close hooks at 1676160223206 (+3 ms)Closed at 1676160223207 (+1 ms) 2023-02-12 00:03:43,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:43,309 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41051,1676160219758; all regions closed. 2023-02-12 00:03:43,310 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37959,1676160219781; all regions closed. 2023-02-12 00:03:43,317 DEBUG [RS:0;jenkins-hbase9:41051] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs 2023-02-12 00:03:43,317 INFO [RS:0;jenkins-hbase9:41051] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41051%2C1676160219758:(num 1676160221082) 2023-02-12 00:03:43,317 DEBUG [RS:0;jenkins-hbase9:41051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,317 INFO [RS:0;jenkins-hbase9:41051] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:43,317 INFO [RS:0;jenkins-hbase9:41051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:43,317 DEBUG [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs 2023-02-12 00:03:43,317 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:43,317 INFO [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37959%2C1676160219781.meta:.meta(num 1676160220688) 2023-02-12 00:03:43,317 INFO [RS:0;jenkins-hbase9:41051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:43,318 INFO [RS:0;jenkins-hbase9:41051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:43,318 INFO [RS:0;jenkins-hbase9:41051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:43,319 INFO [RS:0;jenkins-hbase9:41051] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41051 2023-02-12 00:03:43,322 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:43,322 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:43,322 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:43,322 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41051,1676160219758 2023-02-12 00:03:43,322 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4439f3e rejected from java.util.concurrent.ThreadPoolExecutor@7c0b6e[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,322 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:43,322 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41051,1676160219758] 2023-02-12 00:03:43,322 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41051,1676160219758; numProcessing=1 2023-02-12 00:03:43,324 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41051,1676160219758 already deleted, retry=false 2023-02-12 00:03:43,324 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41051,1676160219758 expired; onlineServers=1 2023-02-12 00:03:43,325 DEBUG [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/oldWALs 2023-02-12 00:03:43,325 INFO [RS:1;jenkins-hbase9:37959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37959%2C1676160219781:(num 1676160221468) 2023-02-12 00:03:43,326 DEBUG [RS:1;jenkins-hbase9:37959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,326 INFO [RS:1;jenkins-hbase9:37959] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:43,326 INFO [RS:1;jenkins-hbase9:37959] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:43,326 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:43,327 INFO [RS:1;jenkins-hbase9:37959] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37959 2023-02-12 00:03:43,328 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37959,1676160219781 2023-02-12 00:03:43,328 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:43,330 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37959,1676160219781] 2023-02-12 00:03:43,331 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37959,1676160219781; numProcessing=2 2023-02-12 00:03:43,334 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37959,1676160219781 already deleted, retry=false 2023-02-12 00:03:43,334 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37959,1676160219781 expired; onlineServers=0 2023-02-12 00:03:43,334 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,44817,1676160219708' ***** 2023-02-12 00:03:43,334 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:43,335 DEBUG [M:0;jenkins-hbase9:44817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9e334ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:43,335 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,44817,1676160219708 2023-02-12 00:03:43,335 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,44817,1676160219708; all regions closed. 2023-02-12 00:03:43,335 DEBUG [M:0;jenkins-hbase9:44817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:43,335 DEBUG [M:0;jenkins-hbase9:44817] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:43,335 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:43,335 DEBUG [M:0;jenkins-hbase9:44817] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:43,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160220339] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160220339,5,FailOnTimeoutGroup] 2023-02-12 00:03:43,335 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160220339] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160220339,5,FailOnTimeoutGroup] 2023-02-12 00:03:43,335 INFO [M:0;jenkins-hbase9:44817] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:43,336 INFO [M:0;jenkins-hbase9:44817] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:43,336 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:43,337 INFO [M:0;jenkins-hbase9:44817] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:43,337 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:43,337 DEBUG [M:0;jenkins-hbase9:44817] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:43,337 INFO [M:0;jenkins-hbase9:44817] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:43,337 ERROR [M:0;jenkins-hbase9:44817] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:43,337 INFO [M:0;jenkins-hbase9:44817] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:43,338 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:43,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:43,338 DEBUG [M:0;jenkins-hbase9:44817] zookeeper.ZKUtil(398): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:43,338 WARN [M:0;jenkins-hbase9:44817] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:43,338 INFO [M:0;jenkins-hbase9:44817] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:43,339 INFO [M:0;jenkins-hbase9:44817] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:43,339 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:43,339 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:43,339 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:43,339 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:43,339 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:43,339 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.68 KB 2023-02-12 00:03:43,369 INFO [M:0;jenkins-hbase9:44817] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8fa86480707847b0b060a3f55d358bc7 2023-02-12 00:03:43,373 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8fa86480707847b0b060a3f55d358bc7 as hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8fa86480707847b0b060a3f55d358bc7 2023-02-12 00:03:43,380 INFO [M:0;jenkins-hbase9:44817] regionserver.HStore(1080): Added hdfs://localhost:40863/user/jenkins/test-data/9023488b-0307-4057-50ac-7440a21fdbf7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8fa86480707847b0b060a3f55d358bc7, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 00:03:43,381 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.66 KB/69288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=132, compaction requested=false 2023-02-12 00:03:43,391 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:43,391 DEBUG [M:0;jenkins-hbase9:44817] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160223339Disabling compacts and flushes for region at 1676160223339Disabling writes for close at 1676160223339Obtaining lock to block concurrent updates at 1676160223339Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160223339Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58043, getHeapSize=69288, getOffHeapSize=0, getCellsCount=145 at 1676160223339Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160223348 (+9 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160223348Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160223351 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160223351Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160223374 (+23 ms)Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.66 KB/69288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=132, compaction requested=false at 1676160223381 (+7 ms)Writing region close event to WAL at 1676160223391 (+10 ms)Closed at 1676160223391 2023-02-12 00:03:43,393 INFO [M:0;jenkins-hbase9:44817] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:43,393 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:43,395 INFO [M:0;jenkins-hbase9:44817] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44817 2023-02-12 00:03:43,396 DEBUG [M:0;jenkins-hbase9:44817] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,44817,1676160219708 already deleted, retry=false 2023-02-12 00:03:43,501 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,501 INFO [M:0;jenkins-hbase9:44817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,44817,1676160219708; zookeeper connection closed. 2023-02-12 00:03:43,501 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b992ff2 rejected from java.util.concurrent.ThreadPoolExecutor@7fa6a459[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,502 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): master:44817-0x10045d81a150000, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,503 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@39808233 rejected from java.util.concurrent.ThreadPoolExecutor@7fa6a459[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,602 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,602 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c83a163 rejected from java.util.concurrent.ThreadPoolExecutor@48bc2c2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,602 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:37959-0x10045d81a150002, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,602 INFO [RS:1;jenkins-hbase9:37959] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37959,1676160219781; zookeeper connection closed. 2023-02-12 00:03:43,602 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d204b2b rejected from java.util.concurrent.ThreadPoolExecutor@48bc2c2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56ee40ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56ee40ad 2023-02-12 00:03:43,702 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,702 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cd39924 rejected from java.util.concurrent.ThreadPoolExecutor@7c0b6e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,702 INFO [RS:0;jenkins-hbase9:41051] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41051,1676160219758; zookeeper connection closed. 2023-02-12 00:03:43,702 DEBUG [Listener at localhost/34047-EventThread] zookeeper.ZKWatcher(600): regionserver:41051-0x10045d81a150001, quorum=127.0.0.1:58153, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:43,702 ERROR [Listener at localhost/34047-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14b60364 rejected from java.util.concurrent.ThreadPoolExecutor@7c0b6e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:43,703 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@51030160] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@51030160 2023-02-12 00:03:43,703 INFO [Listener at localhost/34047] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:43,703 WARN [Listener at localhost/34047] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:43,712 INFO [Listener at localhost/34047] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:43,715 WARN [BP-2065909530-172.31.2.10-1676160218951 heartbeating to localhost/127.0.0.1:40863] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:43,716 WARN [BP-2065909530-172.31.2.10-1676160218951 heartbeating to localhost/127.0.0.1:40863] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2065909530-172.31.2.10-1676160218951 (Datanode Uuid 134f77a9-3962-436a-ab38-6995d3c1b377) service to localhost/127.0.0.1:40863 2023-02-12 00:03:43,718 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/dfs/data/data3/current/BP-2065909530-172.31.2.10-1676160218951] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:43,718 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/dfs/data/data4/current/BP-2065909530-172.31.2.10-1676160218951] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:43,719 WARN [Listener at localhost/34047] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:43,724 INFO [Listener at localhost/34047] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:43,831 WARN [BP-2065909530-172.31.2.10-1676160218951 heartbeating to localhost/127.0.0.1:40863] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:43,831 WARN [BP-2065909530-172.31.2.10-1676160218951 heartbeating to localhost/127.0.0.1:40863] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2065909530-172.31.2.10-1676160218951 (Datanode Uuid a50cfee5-f233-44e5-a240-8428109facce) service to localhost/127.0.0.1:40863 2023-02-12 00:03:43,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/dfs/data/data1/current/BP-2065909530-172.31.2.10-1676160218951] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:43,833 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/cluster_b91770e2-3df9-cd46-18bf-4bb5a060a036/dfs/data/data2/current/BP-2065909530-172.31.2.10-1676160218951] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:43,843 INFO [Listener at localhost/34047] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:43,956 INFO [Listener at localhost/34047] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:43,976 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:43,990 INFO [Listener at localhost/34047] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 253) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:40863 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:40863 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34047 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:40863 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,44817,1676160219708)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:40863 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:40863 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40863 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:40863 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=578 (was 656), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 222) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9340 (was 9361) 2023-02-12 00:03:44,002 INFO [Listener at localhost/34047] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=578, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=167, AvailableMemoryMB=9339 2023-02-12 00:03:44,014 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.log.dir so I do NOT create it in target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239 2023-02-12 00:03:44,014 WARN [Listener at localhost/34047] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 00:03:44,014 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.tmp.dir so I do NOT create it in target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239 2023-02-12 00:03:44,014 WARN [Listener at localhost/34047] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f429c569-f096-2f56-f876-85d0f52c9785/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 00:03:44,014 DEBUG [Listener at localhost/34047] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239 2023-02-12 00:03:44,014 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 00:03:44,014 INFO [Listener at localhost/34047] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744, deleteOnExit=true 2023-02-12 00:03:44,014 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/test.cache.data in system properties and HBase conf 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop.log.dir in system properties and HBase conf 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 00:03:44,015 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 00:03:44,016 DEBUG [Listener at localhost/34047] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 00:03:44,016 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/nfs.dump.dir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/java.io.tmpdir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 00:03:44,017 INFO [Listener at localhost/34047] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 00:03:44,021 WARN [Listener at localhost/34047] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:44,021 WARN [Listener at localhost/34047] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:44,066 WARN [Listener at localhost/34047] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:44,067 INFO [Listener at localhost/34047] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:44,073 INFO [Listener at localhost/34047] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/java.io.tmpdir/Jetty_localhost_40091_hdfs____.el5a16/webapp 2023-02-12 00:03:44,165 INFO [Listener at localhost/34047] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40091 2023-02-12 00:03:44,170 WARN [Listener at localhost/34047] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 00:03:44,170 WARN [Listener at localhost/34047] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 00:03:44,210 WARN [Listener at localhost/46333] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:44,227 WARN [Listener at localhost/46333] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:44,230 WARN [Listener at localhost/46333] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:44,231 INFO [Listener at localhost/46333] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:44,237 INFO [Listener at localhost/46333] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/java.io.tmpdir/Jetty_localhost_45319_datanode____.6b947z/webapp 2023-02-12 00:03:44,329 INFO [Listener at localhost/46333] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45319 2023-02-12 00:03:44,338 WARN [Listener at localhost/40021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:44,353 WARN [Listener at localhost/40021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 00:03:44,355 WARN [Listener at localhost/40021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 00:03:44,356 INFO [Listener at localhost/40021] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 00:03:44,360 INFO [Listener at localhost/40021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/java.io.tmpdir/Jetty_localhost_45369_datanode____mwvk3g/webapp 2023-02-12 00:03:44,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf8def52ff26a0be1: Processing first storage report for DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a from datanode fdfce115-4eb7-4c53-be04-39a50e7f37f5 2023-02-12 00:03:44,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf8def52ff26a0be1: from storage DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a node DatanodeRegistration(127.0.0.1:46549, datanodeUuid=fdfce115-4eb7-4c53-be04-39a50e7f37f5, infoPort=43731, infoSecurePort=0, ipcPort=40021, storageInfo=lv=-57;cid=testClusterID;nsid=1121940418;c=1676160224023), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:44,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf8def52ff26a0be1: Processing first storage report for DS-38da4f90-3d89-432a-bf7b-0cc06bf5d22d from datanode fdfce115-4eb7-4c53-be04-39a50e7f37f5 2023-02-12 00:03:44,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf8def52ff26a0be1: from storage DS-38da4f90-3d89-432a-bf7b-0cc06bf5d22d node DatanodeRegistration(127.0.0.1:46549, datanodeUuid=fdfce115-4eb7-4c53-be04-39a50e7f37f5, infoPort=43731, infoSecurePort=0, ipcPort=40021, storageInfo=lv=-57;cid=testClusterID;nsid=1121940418;c=1676160224023), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:44,475 INFO [Listener at localhost/40021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45369 2023-02-12 00:03:44,484 WARN [Listener at localhost/41691] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 00:03:44,586 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x32eeca26d7c4ff92: Processing first storage report for DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c from datanode 5d5a87e3-874e-46ce-b445-9ec934b0e084 2023-02-12 00:03:44,586 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x32eeca26d7c4ff92: from storage DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c node DatanodeRegistration(127.0.0.1:38895, datanodeUuid=5d5a87e3-874e-46ce-b445-9ec934b0e084, infoPort=35387, infoSecurePort=0, ipcPort=41691, storageInfo=lv=-57;cid=testClusterID;nsid=1121940418;c=1676160224023), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:44,586 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x32eeca26d7c4ff92: Processing first storage report for DS-b0818077-a418-42f7-b943-d87fc379010d from datanode 5d5a87e3-874e-46ce-b445-9ec934b0e084 2023-02-12 00:03:44,586 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x32eeca26d7c4ff92: from storage DS-b0818077-a418-42f7-b943-d87fc379010d node DatanodeRegistration(127.0.0.1:38895, datanodeUuid=5d5a87e3-874e-46ce-b445-9ec934b0e084, infoPort=35387, infoSecurePort=0, ipcPort=41691, storageInfo=lv=-57;cid=testClusterID;nsid=1121940418;c=1676160224023), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 00:03:44,593 DEBUG [Listener at localhost/41691] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239 2023-02-12 00:03:44,596 INFO [Listener at localhost/41691] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/zookeeper_0, clientPort=49276, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 00:03:44,597 INFO [Listener at localhost/41691] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49276 2023-02-12 00:03:44,597 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,597 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,610 INFO [Listener at localhost/41691] util.FSUtils(479): Created version file at hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4 with version=8 2023-02-12 00:03:44,610 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,611 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,612 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/hbase-staging 2023-02-12 00:03:44,613 INFO [Listener at localhost/41691] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:44,613 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,613 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,613 INFO [Listener at localhost/41691] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:44,614 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,614 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:44,614 INFO [Listener at localhost/41691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:44,614 INFO [Listener at localhost/41691] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33733 2023-02-12 00:03:44,615 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,615 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,616 INFO [Listener at localhost/41691] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33733 connecting to ZooKeeper ensemble=127.0.0.1:49276 2023-02-12 00:03:44,629 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:337330x0, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:44,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33733-0x10045d82d410000 connected 2023-02-12 00:03:44,648 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:44,648 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:44,649 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:44,653 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33733 2023-02-12 00:03:44,653 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33733 2023-02-12 00:03:44,653 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33733 2023-02-12 00:03:44,655 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33733 2023-02-12 00:03:44,657 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33733 2023-02-12 00:03:44,657 INFO [Listener at localhost/41691] master.HMaster(439): hbase.rootdir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4, hbase.cluster.distributed=false 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:44,671 INFO [Listener at localhost/41691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:44,672 INFO [Listener at localhost/41691] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37557 2023-02-12 00:03:44,673 INFO [Listener at localhost/41691] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:44,676 DEBUG [Listener at localhost/41691] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:44,676 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,677 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,678 INFO [Listener at localhost/41691] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37557 connecting to ZooKeeper ensemble=127.0.0.1:49276 2023-02-12 00:03:44,681 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:375570x0, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:44,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37557-0x10045d82d410001 connected 2023-02-12 00:03:44,684 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:44,685 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:44,685 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:44,685 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37557 2023-02-12 00:03:44,686 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37557 2023-02-12 00:03:44,686 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37557 2023-02-12 00:03:44,687 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37557 2023-02-12 00:03:44,689 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37557 2023-02-12 00:03:44,699 INFO [Listener at localhost/41691] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-12 00:03:44,699 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,699 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,700 INFO [Listener at localhost/41691] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 00:03:44,700 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 00:03:44,700 INFO [Listener at localhost/41691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 00:03:44,700 INFO [Listener at localhost/41691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 00:03:44,700 INFO [Listener at localhost/41691] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37957 2023-02-12 00:03:44,701 INFO [Listener at localhost/41691] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 00:03:44,701 DEBUG [Listener at localhost/41691] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:44,701 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,702 INFO [Listener at localhost/41691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,703 INFO [Listener at localhost/41691] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37957 connecting to ZooKeeper ensemble=127.0.0.1:49276 2023-02-12 00:03:44,705 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:379570x0, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 00:03:44,705 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:379570x0, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:44,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37957-0x10045d82d410002 connected 2023-02-12 00:03:44,706 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:44,707 DEBUG [Listener at localhost/41691] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 00:03:44,709 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37957 2023-02-12 00:03:44,710 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37957 2023-02-12 00:03:44,711 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37957 2023-02-12 00:03:44,712 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37957 2023-02-12 00:03:44,715 DEBUG [Listener at localhost/41691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37957 2023-02-12 00:03:44,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,718 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:44,718 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,720 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:44,720 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:44,720 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,720 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:44,722 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:44,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,33733,1676160224613 from backup master directory 2023-02-12 00:03:44,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 00:03:44,725 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,725 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 00:03:44,726 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:44,726 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,739 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/hbase.id with ID: 01819787-463f-490b-9c3d-40d3e8bd5a63 2023-02-12 00:03:44,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 00:03:44,748 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,757 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x139e9f3f to 127.0.0.1:49276 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:44,760 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bbfb77d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:44,760 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:44,761 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 00:03:44,761 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:44,762 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store-tmp 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:44,769 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:44,769 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:44,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160224769Disabling compacts and flushes for region at 1676160224769Disabling writes for close at 1676160224769Writing region close event to WAL at 1676160224769Closed at 1676160224769 2023-02-12 00:03:44,770 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/WALs/jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,772 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33733%2C1676160224613, suffix=, logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/WALs/jenkins-hbase9.apache.org,33733,1676160224613, archiveDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/oldWALs, maxLogs=10 2023-02-12 00:03:44,784 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK] 2023-02-12 00:03:44,784 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK] 2023-02-12 00:03:44,786 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/WALs/jenkins-hbase9.apache.org,33733,1676160224613/jenkins-hbase9.apache.org%2C33733%2C1676160224613.1676160224772 2023-02-12 00:03:44,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK], DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK]] 2023-02-12 00:03:44,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:44,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:44,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,787 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,788 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 00:03:44,789 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 00:03:44,789 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:44,790 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,790 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,792 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 00:03:44,795 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:44,796 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62949508, jitterRate=-0.06197923421859741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:44,796 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676160224786Initializing all the Stores at 1676160224787 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160224787Cleaning up temporary data from old regions at 1676160224790 (+3 ms)Cleaning up detritus from prior splits at 1676160224790Region opened successfully at 1676160224796 (+6 ms) 2023-02-12 00:03:44,799 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 00:03:44,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 00:03:44,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 00:03:44,800 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 00:03:44,801 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 00:03:44,801 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 00:03:44,801 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 00:03:44,803 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 00:03:44,803 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 00:03:44,813 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 00:03:44,813 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 00:03:44,814 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 00:03:44,814 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 00:03:44,814 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 00:03:44,816 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 00:03:44,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 00:03:44,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 00:03:44,819 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:44,820 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:44,820 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:44,820 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,821 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,33733,1676160224613, sessionid=0x10045d82d410000, setting cluster-up flag (Was=false) 2023-02-12 00:03:44,825 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,830 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 00:03:44,831 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,833 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:44,838 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 00:03:44,838 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:44,839 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/.tmp 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:44,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676160254842 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 00:03:44,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 00:03:44,843 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:44,843 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,843 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 00:03:44,843 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 00:03:44,844 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:44,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 00:03:44,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 00:03:44,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 00:03:44,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 00:03:44,844 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160224844,5,FailOnTimeoutGroup] 2023-02-12 00:03:44,845 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160224844,5,FailOnTimeoutGroup] 2023-02-12 00:03:44,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 00:03:44,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,853 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:44,854 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:44,854 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4 2023-02-12 00:03:44,862 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:44,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:44,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/info 2023-02-12 00:03:44,864 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:44,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:44,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:44,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:44,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:44,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:44,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:44,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/table 2023-02-12 00:03:44,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:44,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:44,868 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740 2023-02-12 00:03:44,868 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740 2023-02-12 00:03:44,869 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:44,870 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:44,871 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:44,871 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64085611, jitterRate=-0.04504998028278351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676160224862Initializing all the Stores at 1676160224862Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160224862Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160224863 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160224863Cleaning up temporary data from old regions at 1676160224869 (+6 ms)Cleaning up detritus from prior splits at 1676160224869Region opened successfully at 1676160224871 (+2 ms) 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:44,872 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:44,872 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:44,872 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160224872Disabling compacts and flushes for region at 1676160224872Disabling writes for close at 1676160224872Writing region close event to WAL at 1676160224872Closed at 1676160224872 2023-02-12 00:03:44,873 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 00:03:44,921 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 00:03:44,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 00:03:44,926 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(952): ClusterId : 01819787-463f-490b-9c3d-40d3e8bd5a63 2023-02-12 00:03:44,928 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(952): ClusterId : 01819787-463f-490b-9c3d-40d3e8bd5a63 2023-02-12 00:03:44,928 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:44,928 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 00:03:44,928 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 00:03:44,932 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 00:03:44,933 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:44,933 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 00:03:44,933 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:44,933 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 00:03:44,940 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:44,940 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 00:03:44,941 DEBUG [RS:0;jenkins-hbase9:37557] zookeeper.ReadOnlyZKClient(139): Connect 0x101d5d20 to 127.0.0.1:49276 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:44,941 DEBUG [RS:1;jenkins-hbase9:37957] zookeeper.ReadOnlyZKClient(139): Connect 0x0825f3da to 127.0.0.1:49276 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:44,945 DEBUG [RS:0;jenkins-hbase9:37557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1edab153, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:44,945 DEBUG [RS:1;jenkins-hbase9:37957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e20cae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:44,945 DEBUG [RS:0;jenkins-hbase9:37557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ae53650, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:44,945 DEBUG [RS:1;jenkins-hbase9:37957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dd98aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:44,954 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:37957 2023-02-12 00:03:44,954 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:37557 2023-02-12 00:03:44,954 INFO [RS:1;jenkins-hbase9:37957] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:44,954 INFO [RS:1;jenkins-hbase9:37957] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:44,954 INFO [RS:0;jenkins-hbase9:37557] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 00:03:44,954 INFO [RS:0;jenkins-hbase9:37557] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 00:03:44,954 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:44,954 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 00:03:44,954 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,33733,1676160224613 with isa=jenkins-hbase9.apache.org/172.31.2.10:37957, startcode=1676160224699 2023-02-12 00:03:44,954 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,33733,1676160224613 with isa=jenkins-hbase9.apache.org/172.31.2.10:37557, startcode=1676160224670 2023-02-12 00:03:44,955 DEBUG [RS:1;jenkins-hbase9:37957] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:44,955 DEBUG [RS:0;jenkins-hbase9:37557] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 00:03:44,956 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48435, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:44,957 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55301, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 00:03:44,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33733] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:44,958 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:44,959 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4 2023-02-12 00:03:44,959 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46333 2023-02-12 00:03:44,959 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:44,959 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4 2023-02-12 00:03:44,959 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46333 2023-02-12 00:03:44,959 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 00:03:44,960 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:44,970 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37557,1676160224670] 2023-02-12 00:03:44,970 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37957,1676160224699] 2023-02-12 00:03:44,970 DEBUG [RS:0;jenkins-hbase9:37557] zookeeper.ZKUtil(162): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:44,970 DEBUG [RS:1;jenkins-hbase9:37957] zookeeper.ZKUtil(162): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:44,970 WARN [RS:0;jenkins-hbase9:37557] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:44,970 WARN [RS:1;jenkins-hbase9:37957] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 00:03:44,970 INFO [RS:0;jenkins-hbase9:37557] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:44,970 INFO [RS:1;jenkins-hbase9:37957] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:44,970 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:44,970 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:44,977 DEBUG [RS:0;jenkins-hbase9:37557] zookeeper.ZKUtil(162): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:44,977 DEBUG [RS:1;jenkins-hbase9:37957] zookeeper.ZKUtil(162): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:44,977 DEBUG [RS:0;jenkins-hbase9:37557] zookeeper.ZKUtil(162): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:44,977 DEBUG [RS:1;jenkins-hbase9:37957] zookeeper.ZKUtil(162): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:44,978 DEBUG [RS:0;jenkins-hbase9:37557] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:44,978 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 00:03:44,978 INFO [RS:0;jenkins-hbase9:37557] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:44,978 INFO [RS:1;jenkins-hbase9:37957] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 00:03:44,979 INFO [RS:0;jenkins-hbase9:37557] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:44,979 INFO [RS:0;jenkins-hbase9:37557] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:44,979 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,979 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:44,981 INFO [RS:1;jenkins-hbase9:37957] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 00:03:44,983 INFO [RS:1;jenkins-hbase9:37957] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 00:03:44,983 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,984 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,984 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 00:03:44,986 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,986 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,986 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,986 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:44,987 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:0;jenkins-hbase9:37557] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,987 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,988 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-12 00:03:44,988 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,988 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,988 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,988 DEBUG [RS:1;jenkins-hbase9:37957] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-12 00:03:44,990 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,990 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,990 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,991 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,991 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:44,991 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,001 INFO [RS:1;jenkins-hbase9:37957] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:45,001 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37957,1676160224699-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,004 INFO [RS:0;jenkins-hbase9:37557] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 00:03:45,004 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37557,1676160224670-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,014 INFO [RS:1;jenkins-hbase9:37957] regionserver.Replication(203): jenkins-hbase9.apache.org,37957,1676160224699 started 2023-02-12 00:03:45,014 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37957,1676160224699, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37957, sessionid=0x10045d82d410002 2023-02-12 00:03:45,014 INFO [RS:0;jenkins-hbase9:37557] regionserver.Replication(203): jenkins-hbase9.apache.org,37557,1676160224670 started 2023-02-12 00:03:45,014 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:45,014 DEBUG [RS:1;jenkins-hbase9:37957] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:45,014 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37557,1676160224670, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37557, sessionid=0x10045d82d410001 2023-02-12 00:03:45,014 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37957,1676160224699' 2023-02-12 00:03:45,014 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:45,014 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 00:03:45,014 DEBUG [RS:0;jenkins-hbase9:37557] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:45,014 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37557,1676160224670' 2023-02-12 00:03:45,014 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37557,1676160224670' 2023-02-12 00:03:45,015 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37957,1676160224699' 2023-02-12 00:03:45,015 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:45,016 DEBUG [RS:0;jenkins-hbase9:37557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:45,016 DEBUG [RS:1;jenkins-hbase9:37957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:45,016 DEBUG [RS:0;jenkins-hbase9:37557] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:45,016 INFO [RS:0;jenkins-hbase9:37557] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:45,016 INFO [RS:0;jenkins-hbase9:37557] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:45,016 DEBUG [RS:1;jenkins-hbase9:37957] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 00:03:45,016 INFO [RS:1;jenkins-hbase9:37957] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 00:03:45,016 INFO [RS:1;jenkins-hbase9:37957] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 00:03:45,082 DEBUG [jenkins-hbase9:33733] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 00:03:45,082 DEBUG [jenkins-hbase9:33733] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:45,083 DEBUG [jenkins-hbase9:33733] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:45,083 DEBUG [jenkins-hbase9:33733] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:45,083 DEBUG [jenkins-hbase9:33733] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:45,084 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37957,1676160224699, state=OPENING 2023-02-12 00:03:45,085 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 00:03:45,086 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:45,086 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:45,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37957,1676160224699}] 2023-02-12 00:03:45,241 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:45,241 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:45,242 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:45,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 00:03:45,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 00:03:45,247 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37957%2C1676160224699.meta, suffix=.meta, logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37957,1676160224699, archiveDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs, maxLogs=32 2023-02-12 00:03:45,261 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK] 2023-02-12 00:03:45,262 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK] 2023-02-12 00:03:45,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37957,1676160224699/jenkins-hbase9.apache.org%2C37957%2C1676160224699.meta.1676160225247.meta 2023-02-12 00:03:45,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK], DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK]] 2023-02-12 00:03:45,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 00:03:45,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 00:03:45,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 00:03:45,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 00:03:45,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/info 2023-02-12 00:03:45,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/info 2023-02-12 00:03:45,266 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 00:03:45,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:45,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 00:03:45,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:45,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 00:03:45,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 00:03:45,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:45,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 00:03:45,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/table 2023-02-12 00:03:45,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/table 2023-02-12 00:03:45,269 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 00:03:45,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:45,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740 2023-02-12 00:03:45,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740 2023-02-12 00:03:45,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 00:03:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 00:03:45,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72052390, jitterRate=0.07366427779197693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 00:03:45,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676160225264Writing region info on filesystem at 1676160225264Initializing all the Stores at 1676160225265 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160225265Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160225265Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160225265Cleaning up temporary data from old regions at 1676160225271 (+6 ms)Cleaning up detritus from prior splits at 1676160225271Running coprocessor post-open hooks at 1676160225273 (+2 ms)Region opened successfully at 1676160225273 2023-02-12 00:03:45,274 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676160225241 2023-02-12 00:03:45,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 00:03:45,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 00:03:45,279 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37957,1676160224699, state=OPEN 2023-02-12 00:03:45,281 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 00:03:45,281 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 00:03:45,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 00:03:45,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37957,1676160224699 in 195 msec 2023-02-12 00:03:45,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 00:03:45,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-12 00:03:45,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 445 msec 2023-02-12 00:03:45,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676160224718, completionTime=-1 2023-02-12 00:03:45,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 00:03:45,285 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 00:03:45,287 DEBUG [hconnection-0x755baa52-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:45,288 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:45,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 00:03:45,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676160285289 2023-02-12 00:03:45,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676160345289 2023-02-12 00:03:45,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33733,1676160224613-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33733,1676160224613-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33733,1676160224613-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:33733, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 00:03:45,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:45,295 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 00:03:45,296 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 00:03:45,296 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:45,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:45,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/hbase/namespace/f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/hbase/namespace/f6bb401da1a03020d481b552924a531e empty. 2023-02-12 00:03:45,299 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/hbase/namespace/f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,299 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 00:03:45,307 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:45,307 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f6bb401da1a03020d481b552924a531e, NAME => 'hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f6bb401da1a03020d481b552924a531e, disabling compactions & flushes 2023-02-12 00:03:45,321 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. after waiting 0 ms 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,321 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,321 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f6bb401da1a03020d481b552924a531e: Waiting for close lock at 1676160225321Disabling compacts and flushes for region at 1676160225321Disabling writes for close at 1676160225321Writing region close event to WAL at 1676160225321Closed at 1676160225321 2023-02-12 00:03:45,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:45,323 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160225323"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160225323"}]},"ts":"1676160225323"} 2023-02-12 00:03:45,325 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:45,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:45,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160225326"}]},"ts":"1676160225326"} 2023-02-12 00:03:45,327 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 00:03:45,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:45,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:45,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:45,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:45,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f6bb401da1a03020d481b552924a531e, ASSIGN}] 2023-02-12 00:03:45,334 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f6bb401da1a03020d481b552924a531e, ASSIGN 2023-02-12 00:03:45,334 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f6bb401da1a03020d481b552924a531e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37957,1676160224699; forceNewPlan=false, retain=false 2023-02-12 00:03:45,484 INFO [jenkins-hbase9:33733] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:45,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f6bb401da1a03020d481b552924a531e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:45,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160225485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160225485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160225485"}]},"ts":"1676160225485"} 2023-02-12 00:03:45,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f6bb401da1a03020d481b552924a531e, server=jenkins-hbase9.apache.org,37957,1676160224699}] 2023-02-12 00:03:45,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37957%2C1676160224699, suffix=, logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37957,1676160224699, archiveDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs, maxLogs=32 2023-02-12 00:03:45,655 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK] 2023-02-12 00:03:45,655 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK] 2023-02-12 00:03:45,657 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37957,1676160224699/jenkins-hbase9.apache.org%2C37957%2C1676160224699.1676160225642 2023-02-12 00:03:45,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK], DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK]] 2023-02-12 00:03:45,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6bb401da1a03020d481b552924a531e, NAME => 'hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:45,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:45,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,659 INFO [StoreOpener-f6bb401da1a03020d481b552924a531e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,660 DEBUG [StoreOpener-f6bb401da1a03020d481b552924a531e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/info 2023-02-12 00:03:45,660 DEBUG [StoreOpener-f6bb401da1a03020d481b552924a531e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/info 2023-02-12 00:03:45,660 INFO [StoreOpener-f6bb401da1a03020d481b552924a531e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6bb401da1a03020d481b552924a531e columnFamilyName info 2023-02-12 00:03:45,660 INFO [StoreOpener-f6bb401da1a03020d481b552924a531e-1] regionserver.HStore(310): Store=f6bb401da1a03020d481b552924a531e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:45,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:45,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:45,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f6bb401da1a03020d481b552924a531e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60394409, jitterRate=-0.10005317628383636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 00:03:45,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f6bb401da1a03020d481b552924a531e: Running coprocessor pre-open hook at 1676160225658Writing region info on filesystem at 1676160225658Initializing all the Stores at 1676160225658Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676160225658Cleaning up temporary data from old regions at 1676160225662 (+4 ms)Cleaning up detritus from prior splits at 1676160225662Running coprocessor post-open hooks at 1676160225665 (+3 ms)Region opened successfully at 1676160225665 2023-02-12 00:03:45,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e., pid=6, masterSystemTime=1676160225638 2023-02-12 00:03:45,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:45,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f6bb401da1a03020d481b552924a531e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:45,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676160225668"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160225668"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160225668"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160225668"}]},"ts":"1676160225668"} 2023-02-12 00:03:45,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 00:03:45,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f6bb401da1a03020d481b552924a531e, server=jenkins-hbase9.apache.org,37957,1676160224699 in 184 msec 2023-02-12 00:03:45,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 00:03:45,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f6bb401da1a03020d481b552924a531e, ASSIGN in 341 msec 2023-02-12 00:03:45,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:45,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160225673"}]},"ts":"1676160225673"} 2023-02-12 00:03:45,674 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 00:03:45,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:45,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-12 00:03:45,696 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 00:03:45,697 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:45,697 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:45,700 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 00:03:45,706 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:45,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-12 00:03:45,711 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 00:03:45,718 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 00:03:45,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 00:03:45,725 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 00:03:45,728 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.002sec 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33733,1676160224613-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 00:03:45,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33733,1676160224613-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 00:03:45,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 00:03:45,825 DEBUG [Listener at localhost/41691] zookeeper.ReadOnlyZKClient(139): Connect 0x320adf99 to 127.0.0.1:49276 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:45,828 DEBUG [Listener at localhost/41691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@329a27de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:45,830 DEBUG [hconnection-0x313de8a4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:45,831 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:45,833 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:45,833 DEBUG [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 00:03:45,835 DEBUG [Listener at localhost/41691] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 00:03:45,836 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 00:03:45,836 INFO [Listener at localhost/41691] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 00:03:45,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-12 00:03:45,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 00:03:45,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.10:45304 deadline: 1676160285837, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 00:03:45,837 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 00:03:45,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 00:03:45,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 00:03:45,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 00:03:45,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 00:03:45,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 00:03:45,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:45,843 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:45,843 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 empty. 2023-02-12 00:03:45,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:45,844 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 00:03:45,851 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 00:03:45,852 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 671f336caabb753493bd3720c250ced9, NAME => 'testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 671f336caabb753493bd3720c250ced9, disabling compactions & flushes 2023-02-12 00:03:45,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. after waiting 0 ms 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:45,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:45,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 671f336caabb753493bd3720c250ced9: Waiting for close lock at 1676160225857Disabling compacts and flushes for region at 1676160225857Disabling writes for close at 1676160225857Writing region close event to WAL at 1676160225857Closed at 1676160225857 2023-02-12 00:03:45,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 00:03:45,860 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676160225860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160225860"}]},"ts":"1676160225860"} 2023-02-12 00:03:45,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 00:03:45,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 00:03:45,861 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160225861"}]},"ts":"1676160225861"} 2023-02-12 00:03:45,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 00:03:45,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-12 00:03:45,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 00:03:45,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 00:03:45,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 00:03:45,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, ASSIGN}] 2023-02-12 00:03:45,868 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, ASSIGN 2023-02-12 00:03:45,868 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37557,1676160224670; forceNewPlan=false, retain=false 2023-02-12 00:03:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:46,017 INFO [RS:0;jenkins-hbase9:37557] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37557%2C1676160224670, suffix=, logDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37557,1676160224670, archiveDir=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs, maxLogs=32 2023-02-12 00:03:46,018 INFO [jenkins-hbase9:33733] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 00:03:46,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=671f336caabb753493bd3720c250ced9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676160226018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160226018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160226018"}]},"ts":"1676160226018"} 2023-02-12 00:03:46,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 671f336caabb753493bd3720c250ced9, server=jenkins-hbase9.apache.org,37557,1676160224670}] 2023-02-12 00:03:46,033 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK] 2023-02-12 00:03:46,033 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK] 2023-02-12 00:03:46,034 INFO [RS:0;jenkins-hbase9:37557] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/WALs/jenkins-hbase9.apache.org,37557,1676160224670/jenkins-hbase9.apache.org%2C37557%2C1676160224670.1676160226018 2023-02-12 00:03:46,034 DEBUG [RS:0;jenkins-hbase9:37557] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38895,DS-7338230d-9bf8-4b61-b59e-e8c6a76a493c,DISK], DatanodeInfoWithStorage[127.0.0.1:46549,DS-e5a74371-acf0-40f4-a1dd-5946d3a2439a,DISK]] 2023-02-12 00:03:46,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:46,173 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,173 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 00:03:46,175 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 00:03:46,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 671f336caabb753493bd3720c250ced9, NAME => 'testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 00:03:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,179 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,180 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1 2023-02-12 00:03:46,181 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1 2023-02-12 00:03:46,181 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 671f336caabb753493bd3720c250ced9 columnFamilyName f1 2023-02-12 00:03:46,181 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(310): Store=671f336caabb753493bd3720c250ced9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:46,181 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,182 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2 2023-02-12 00:03:46,182 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2 2023-02-12 00:03:46,183 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 671f336caabb753493bd3720c250ced9 columnFamilyName f2 2023-02-12 00:03:46,183 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(310): Store=671f336caabb753493bd3720c250ced9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:46,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:46,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:46,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 00:03:46,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 671f336caabb753493bd3720c250ced9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66523940, jitterRate=-0.008716046810150146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 671f336caabb753493bd3720c250ced9: Running coprocessor pre-open hook at 1676160226178Writing region info on filesystem at 1676160226178Initializing all the Stores at 1676160226179 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160226179Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160226179Cleaning up temporary data from old regions at 1676160226185 (+6 ms)Cleaning up detritus from prior splits at 1676160226185Running coprocessor post-open hooks at 1676160226188 (+3 ms)Region opened successfully at 1676160226188 2023-02-12 00:03:46,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9., pid=12, masterSystemTime=1676160226173 2023-02-12 00:03:46,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=671f336caabb753493bd3720c250ced9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676160226193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676160226193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676160226193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676160226193"}]},"ts":"1676160226193"} 2023-02-12 00:03:46,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 00:03:46,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 671f336caabb753493bd3720c250ced9, server=jenkins-hbase9.apache.org,37557,1676160224670 in 174 msec 2023-02-12 00:03:46,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 00:03:46,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, ASSIGN in 329 msec 2023-02-12 00:03:46,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 00:03:46,198 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160226198"}]},"ts":"1676160226198"} 2023-02-12 00:03:46,200 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 00:03:46,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 00:03:46,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 363 msec 2023-02-12 00:03:46,205 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 00:03:46,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 00:03:46,447 INFO [Listener at localhost/41691] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 00:03:46,447 DEBUG [Listener at localhost/41691] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 00:03:46,447 INFO [Listener at localhost/41691] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:46,449 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 00:03:46,449 INFO [Listener at localhost/41691] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 00:03:46,449 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 00:03:46,449 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 00:03:46,462 DEBUG [hconnection-0x313de8a4-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:46,475 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:46,482 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,562 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 00:03:46,562 INFO [Listener at localhost/41691] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 00:03:46,563 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676160226563 (current time:1676160226563). 2023-02-12 00:03:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 00:03:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] zookeeper.ReadOnlyZKClient(139): Connect 0x753d0859 to 127.0.0.1:49276 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 00:03:46,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78345c19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 00:03:46,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 00:03:46,568 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 00:03:46,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x753d0859 to 127.0.0.1:49276 2023-02-12 00:03:46,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:46,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 00:03:46,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:46,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:46,572 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:46,573 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676160826573 2023-02-12 00:03:46,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 00:03:46,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 00:03:46,573 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:46,574 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 00:03:46,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:46,574 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 00:03:46,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 3 msec 2023-02-12 00:03:46,576 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:46,576 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676160826576 2023-02-12 00:03:46,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-12 00:03:46,583 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-12 00:03:46,583 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:46,584 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-12 00:03:46,584 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 00:03:46,584 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,584 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,587 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:46,587 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:46,587 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:46,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:46,588 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,588 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 00:03:46,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 00:03:46,589 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 00:03:46,589 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 00:03:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 00:03:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37557,1676160224670' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 00:03:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 00:03:46,592 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 00:03:46,592 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 00:03:46,593 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37957,1676160224699' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 00:03:46,594 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,594 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:46,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37557,1676160224670' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-12 00:03:46,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b3e98e7[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:46,597 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 00:03:46,597 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:46,598 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,598 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,598 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 00:03:46,598 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 00:03:46,598 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,598 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 00:03:46,598 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. started... 2023-02-12 00:03:46,598 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 00:03:46,599 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37957,1676160224699' in zk 2023-02-12 00:03:46,599 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 671f336caabb753493bd3720c250ced9 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 00:03:46,601 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:46,601 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:46,601 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 00:03:46,611 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f1/00254220ca2540d0874dcb1aa2c380d9 2023-02-12 00:03:46,627 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f2/2318e408f4d4413fa9f18e712a8725ab 2023-02-12 00:03:46,630 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f1/00254220ca2540d0874dcb1aa2c380d9 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9 2023-02-12 00:03:46,634 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:46,634 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f2/2318e408f4d4413fa9f18e712a8725ab as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab 2023-02-12 00:03:46,638 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 00:03:46,638 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 671f336caabb753493bd3720c250ced9 in 39ms, sequenceid=5, compaction requested=false 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 671f336caabb753493bd3720c250ced9: 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9] hfiles 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9 for snapshot=testWithMapReduceSingleRegion 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab] hfiles 2023-02-12 00:03:46,639 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab for snapshot=testWithMapReduceSingleRegion 2023-02-12 00:03:46,644 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. completed. 2023-02-12 00:03:46,644 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,644 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 00:03:46,644 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 00:03:46,644 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,644 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 00:03:46,644 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37557,1676160224670' in zk 2023-02-12 00:03:46,646 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 00:03:46,646 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,646 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:46,646 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 00:03:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,37557,1676160224670': 2023-02-12 00:03:46,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37557,1676160224670' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 00:03:46,649 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-12 00:03:46,649 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:46,649 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:46,649 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-12 00:03:46,649 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 00:03:46,651 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:46,651 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:46,651 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 00:03:46,651 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:46,652 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,653 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,653 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 00:03:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,659 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:46,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:46,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 00:03:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 00:03:46,659 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 00:03:46,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-12 00:03:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:46,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-12 00:03:46,660 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:46,660 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 00:03:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 00:03:46,660 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:46,660 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 00:03:46,660 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 00:03:46,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 00:03:46,674 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:46,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-12 00:03:46,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:46,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 00:03:46,675 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 00:03:46,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-12 00:03:46,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 00:03:46,691 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 00:03:46,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676160226573Consolidate snapshot: testWithMapReduceSingleRegion at 1676160226660 (+87 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676160226660Writing data manifest for testWithMapReduceSingleRegion at 1676160226662 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676160226669 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676160226691 (+22 ms) 2023-02-12 00:03:46,691 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 00:03:46,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 118 msec 2023-02-12 00:03:46,875 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 00:03:46,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 00:03:46,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 00:03:46,876 INFO [Listener at localhost/41691] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 00:03:46,880 INFO [Listener at localhost/41691] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 00:03:46,884 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 00:03:46,911 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:46,994 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 00:03:46,999 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-12 00:03:47,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 00:03:47,001 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 00:03:47,001 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:47,001 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 00:03:47,002 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 00:03:47,002 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,002 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,003 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:47,003 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:47,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:47,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:47,003 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,004 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,004 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:47,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 00:03:47,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 00:03:47,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:47,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:47,005 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37957,1676160224699' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:47,006 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,007 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,007 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:47,010 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 00:03:47,010 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 00:03:47,011 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,011 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. started... 2023-02-12 00:03:47,011 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 671f336caabb753493bd3720c250ced9 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 00:03:47,027 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7 2023-02-12 00:03:47,051 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f2/04eaeb8037b24ae093a7895fc92b1811 2023-02-12 00:03:47,056 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7 2023-02-12 00:03:47,059 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:47,060 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/.tmp/f2/04eaeb8037b24ae093a7895fc92b1811 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/04eaeb8037b24ae093a7895fc92b1811 2023-02-12 00:03:47,064 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/04eaeb8037b24ae093a7895fc92b1811, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 00:03:47,065 INFO [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 671f336caabb753493bd3720c250ced9 in 54ms, sequenceid=9, compaction requested=false 2023-02-12 00:03:47,065 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 671f336caabb753493bd3720c250ced9: 2023-02-12 00:03:47,065 DEBUG [rs(jenkins-hbase9.apache.org,37557,1676160224670)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,065 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 00:03:47,065 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 00:03:47,065 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,065 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 00:03:47,065 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37557,1676160224670' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 00:03:47,067 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,067 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,067 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,067 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 00:03:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:47,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37557,1676160224670' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 00:03:47,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f011158[Count = 0] remaining members to acquire global barrier 2023-02-12 00:03:47,069 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 00:03:47,069 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,071 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 00:03:47,071 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,37557,1676160224670' in zk 2023-02-12 00:03:47,071 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,37957,1676160224699' in zk 2023-02-12 00:03:47,072 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:47,072 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,072 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,073 DEBUG [member: 'jenkins-hbase9.apache.org,37557,1676160224670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:47,072 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:47,073 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:47,073 DEBUG [member: 'jenkins-hbase9.apache.org,37957,1676160224699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,37557,1676160224670': 2023-02-12 00:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37557,1676160224670' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 00:03:47,075 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 00:03:47,075 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 00:03:47,075 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 00:03:47,075 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 00:03:47,075 INFO [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 00:03:47,076 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,076 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 00:03:47,076 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:47,077 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 00:03:47,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:47,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:47,077 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 00:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,079 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,079 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 00:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 00:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 00:03:47,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:47,081 DEBUG [(jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 00:03:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 00:03:47,081 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 00:03:47,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 00:03:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 00:03:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 00:03:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 00:03:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 00:03:47,082 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 00:03:47,182 DEBUG [Listener at localhost/41691] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 00:03:47,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 00:03:47,270 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop-6927471643894816215.jar 2023-02-12 00:03:47,273 INFO [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676160226563 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:47,273 DEBUG [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f/data/default/testWithMapReduce 2023-02-12 00:03:47,274 INFO [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(239): region to add: 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:47,274 INFO [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(585): clone region=671f336caabb753493bd3720c250ced9 as 671f336caabb753493bd3720c250ced9 in snapshot testWithMapReduceSingleRegion 2023-02-12 00:03:47,274 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 671f336caabb753493bd3720c250ced9, NAME => 'testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f 2023-02-12 00:03:47,280 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:47,280 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 00254220ca2540d0874dcb1aa2c380d9 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 00:03:47,282 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2318e408f4d4413fa9f18e712a8725ab from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 00:03:47,283 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 671f336caabb753493bd3720c250ced9, disabling compactions & flushes 2023-02-12 00:03:47,283 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,283 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,283 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. after waiting 0 ms 2023-02-12 00:03:47,283 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,283 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:47,283 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 671f336caabb753493bd3720c250ced9: Waiting for close lock at 1676160227283Disabling compacts and flushes for region at 1676160227283Disabling writes for close at 1676160227283Writing region close event to WAL at 1676160227283Closed at 1676160227283 2023-02-12 00:03:47,284 INFO [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676160226563 type: FLUSH version: 2 ttl: 0 2023-02-12 00:03:47,284 DEBUG [Listener at localhost/41691] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f 2023-02-12 00:03:47,284 DEBUG [Listener at localhost/41691] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f 2023-02-12 00:03:47,284 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |-data/ 2023-02-12 00:03:47,285 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |----default/ 2023-02-12 00:03:47,285 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 00:03:47,285 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |----------671f336caabb753493bd3720c250ced9/ 2023-02-12 00:03:47,286 DEBUG [Listener at localhost/41691] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 00:03:47,286 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 00:03:47,286 DEBUG [Listener at localhost/41691] util.CommonFSUtils(702): |----------------testWithMapReduce=671f336caabb753493bd3720c250ced9-00254220ca2540d0874dcb1aa2c380d9 2023-02-12 00:03:47,286 DEBUG [Listener at localhost/41691] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 00:03:47,286 DEBUG [Listener at localhost/41691] util.CommonFSUtils(702): |----------------testWithMapReduce=671f336caabb753493bd3720c250ced9-2318e408f4d4413fa9f18e712a8725ab 2023-02-12 00:03:47,287 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:47,287 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:47,287 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:47,288 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,284 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop-4026629366914949211.jar 2023-02-12 00:03:48,284 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,285 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,353 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop-6294943664976554203.jar 2023-02-12 00:03:48,354 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,354 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,355 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,355 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,355 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,356 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,356 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 00:03:48,356 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 00:03:48,357 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 00:03:48,357 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 00:03:48,357 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 00:03:48,358 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 00:03:48,358 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 00:03:48,358 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 00:03:48,359 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 00:03:48,359 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 00:03:48,360 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 00:03:48,360 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:48,361 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:48,361 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 00:03:48,361 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:48,454 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/hadoop-3155778144801498414.jar 2023-02-12 00:03:48,455 DEBUG [Listener at localhost/41691] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 00:03:48,470 WARN [Listener at localhost/41691] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 00:03:48,480 WARN [Listener at localhost/41691] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 00:03:48,488 INFO [Listener at localhost/41691] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 00:03:48,589 WARN [Listener at localhost/41691] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/mapreduce.cluster.local.dir/1676160228546/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 00:03:48,589 WARN [Listener at localhost/41691] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/mapreduce.cluster.local.dir/1676160228546/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 00:03:48,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 00:03:48,625 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 00:03:48,625 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 00:03:48,627 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:48,628 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1 2023-02-12 00:03:48,628 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 671f336caabb753493bd3720c250ced9 columnFamilyName f1 2023-02-12 00:03:48,634 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(539): loaded hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/testWithMapReduce=671f336caabb753493bd3720c250ced9-00254220ca2540d0874dcb1aa2c380d9 2023-02-12 00:03:48,634 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(310): Store=671f336caabb753493bd3720c250ced9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:48,634 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:48,635 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2 2023-02-12 00:03:48,636 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 671f336caabb753493bd3720c250ced9 columnFamilyName f2 2023-02-12 00:03:48,645 DEBUG [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(539): loaded hdfs://localhost:46333/user/jenkins/test-data/3bf35645-e83b-5f5c-ba71-0e0e9904cf2a/testWithMapReduceSingleRegion/75aa8ad5-d1f9-4510-84f6-c7800ef1d66f/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/testWithMapReduce=671f336caabb753493bd3720c250ced9-2318e408f4d4413fa9f18e712a8725ab 2023-02-12 00:03:48,645 INFO [StoreOpener-671f336caabb753493bd3720c250ced9-1] regionserver.HStore(310): Store=671f336caabb753493bd3720c250ced9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 00:03:48,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 00:03:48,645 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 671f336caabb753493bd3720c250ced9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62436352, jitterRate=-0.0696258544921875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 00:03:48,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 671f336caabb753493bd3720c250ced9: Writing region info on filesystem at 1676160228625Initializing all the Stores at 1676160228626 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160228626Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676160228626Region opened successfully at 1676160228645 (+19 ms) 2023-02-12 00:03:48,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 671f336caabb753493bd3720c250ced9, disabling compactions & flushes 2023-02-12 00:03:48,795 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:48,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:48,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. after waiting 0 ms 2023-02-12 00:03:48,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:48,796 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:48,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 671f336caabb753493bd3720c250ced9: Waiting for close lock at 1676160228795Disabling compacts and flushes for region at 1676160228795Disabling writes for close at 1676160228795Writing region close event to WAL at 1676160228796 (+1 ms)Closed at 1676160228796 2023-02-12 00:03:49,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceSingleRegion" 2023-02-12 00:03:49,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-12 00:03:49,630 INFO [Listener at localhost/41691] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 00:03:49,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-12 00:03:49,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:49,634 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160229634"}]},"ts":"1676160229634"} 2023-02-12 00:03:49,635 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 00:03:49,636 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 00:03:49,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, UNASSIGN}] 2023-02-12 00:03:49,640 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, UNASSIGN 2023-02-12 00:03:49,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=671f336caabb753493bd3720c250ced9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:49,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676160229640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676160229640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676160229640"}]},"ts":"1676160229640"} 2023-02-12 00:03:49,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 671f336caabb753493bd3720c250ced9, server=jenkins-hbase9.apache.org,37557,1676160224670}] 2023-02-12 00:03:49,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:49,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:49,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 671f336caabb753493bd3720c250ced9, disabling compactions & flushes 2023-02-12 00:03:49,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:49,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:49,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. after waiting 0 ms 2023-02-12 00:03:49,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:49,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 00:03:49,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9. 2023-02-12 00:03:49,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 671f336caabb753493bd3720c250ced9: Waiting for close lock at 1676160229794Running coprocessor pre-close hooks at 1676160229794Disabling compacts and flushes for region at 1676160229794Disabling writes for close at 1676160229794Writing region close event to WAL at 1676160229796 (+2 ms)Running coprocessor post-close hooks at 1676160229799 (+3 ms)Closed at 1676160229803 (+4 ms) 2023-02-12 00:03:49,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=671f336caabb753493bd3720c250ced9, regionState=CLOSED 2023-02-12 00:03:49,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676160229806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676160229806"}]},"ts":"1676160229806"} 2023-02-12 00:03:49,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 671f336caabb753493bd3720c250ced9 2023-02-12 00:03:49,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 00:03:49,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 671f336caabb753493bd3720c250ced9, server=jenkins-hbase9.apache.org,37557,1676160224670 in 165 msec 2023-02-12 00:03:49,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 00:03:49,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=671f336caabb753493bd3720c250ced9, UNASSIGN in 170 msec 2023-02-12 00:03:49,811 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676160229811"}]},"ts":"1676160229811"} 2023-02-12 00:03:49,812 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 00:03:49,814 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 00:03:49,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 183 msec 2023-02-12 00:03:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 00:03:49,938 INFO [Listener at localhost/41691] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-12 00:03:49,939 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-12 00:03:49,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:49,946 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,950 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:49,953 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1, FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2, FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/recovered.edits] 2023-02-12 00:03:49,957 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9 to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/archive/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/00254220ca2540d0874dcb1aa2c380d9 2023-02-12 00:03:49,958 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7 to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/archive/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f1/c69cc4dc844b4dc1bdaa3cc11304e5a7 2023-02-12 00:03:49,962 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/04eaeb8037b24ae093a7895fc92b1811 to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/archive/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/04eaeb8037b24ae093a7895fc92b1811 2023-02-12 00:03:49,964 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/archive/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/f2/2318e408f4d4413fa9f18e712a8725ab 2023-02-12 00:03:49,966 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/recovered.edits/12.seqid to hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/archive/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9/recovered.edits/12.seqid 2023-02-12 00:03:49,967 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/.tmp/data/default/testWithMapReduce/671f336caabb753493bd3720c250ced9 2023-02-12 00:03:49,967 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 00:03:49,971 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,975 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-12 00:03:49,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 00:03:49,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 00:03:49,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676160229982"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:49,988 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 00:03:49,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 671f336caabb753493bd3720c250ced9, NAME => 'testWithMapReduce,,1676160225839.671f336caabb753493bd3720c250ced9.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 00:03:49,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 00:03:49,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676160229989"}]},"ts":"9223372036854775807"} 2023-02-12 00:03:49,992 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 00:03:49,993 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 00:03:49,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 55 msec 2023-02-12 00:03:50,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33733] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 00:03:50,048 INFO [Listener at localhost/41691] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-12 00:03:50,048 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 00:03:50,048 INFO [Listener at localhost/41691] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 00:03:50,048 DEBUG [Listener at localhost/41691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x320adf99 to 127.0.0.1:49276 2023-02-12 00:03:50,048 DEBUG [Listener at localhost/41691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,048 DEBUG [Listener at localhost/41691] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 00:03:50,048 DEBUG [Listener at localhost/41691] util.JVMClusterUtil(257): Found active master hash=1421309057, stopped=false 2023-02-12 00:03:50,048 INFO [Listener at localhost/41691] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:50,052 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:50,052 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:50,052 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 00:03:50,052 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:50,052 INFO [Listener at localhost/41691] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 00:03:50,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:50,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:50,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 00:03:50,054 DEBUG [Listener at localhost/41691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x139e9f3f to 127.0.0.1:49276 2023-02-12 00:03:50,054 DEBUG [Listener at localhost/41691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,055 INFO [Listener at localhost/41691] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37557,1676160224670' ***** 2023-02-12 00:03:50,055 INFO [Listener at localhost/41691] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:50,055 INFO [Listener at localhost/41691] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37957,1676160224699' ***** 2023-02-12 00:03:50,055 INFO [Listener at localhost/41691] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 00:03:50,055 INFO [RS:0;jenkins-hbase9:37557] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:50,055 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:50,055 INFO [RS:0;jenkins-hbase9:37557] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:50,056 INFO [RS:0;jenkins-hbase9:37557] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:50,056 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:50,056 DEBUG [RS:0;jenkins-hbase9:37557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101d5d20 to 127.0.0.1:49276 2023-02-12 00:03:50,057 DEBUG [RS:0;jenkins-hbase9:37557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,057 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37557,1676160224670; all regions closed. 2023-02-12 00:03:50,056 INFO [RS:1;jenkins-hbase9:37957] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 00:03:50,060 INFO [RS:1;jenkins-hbase9:37957] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 00:03:50,060 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 00:03:50,060 INFO [RS:1;jenkins-hbase9:37957] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 00:03:50,061 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(3304): Received CLOSE for f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:50,062 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:50,062 DEBUG [RS:1;jenkins-hbase9:37957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0825f3da to 127.0.0.1:49276 2023-02-12 00:03:50,062 DEBUG [RS:1;jenkins-hbase9:37957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,062 INFO [RS:1;jenkins-hbase9:37957] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:50,062 INFO [RS:1;jenkins-hbase9:37957] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:50,063 INFO [RS:1;jenkins-hbase9:37957] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:50,063 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f6bb401da1a03020d481b552924a531e, disabling compactions & flushes 2023-02-12 00:03:50,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 00:03:50,063 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 00:03:50,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 00:03:50,063 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, f6bb401da1a03020d481b552924a531e=hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e.} 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. after waiting 0 ms 2023-02-12 00:03:50,063 DEBUG [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1505): Waiting on 1588230740, f6bb401da1a03020d481b552924a531e 2023-02-12 00:03:50,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-12 00:03:50,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:50,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing f6bb401da1a03020d481b552924a531e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 00:03:50,072 DEBUG [RS:0;jenkins-hbase9:37557] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37557%2C1676160224670:(num 1676160226018) 2023-02-12 00:03:50,073 DEBUG [RS:0;jenkins-hbase9:37557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 00:03:50,073 INFO [RS:0;jenkins-hbase9:37557] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 00:03:50,073 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:50,077 INFO [RS:0;jenkins-hbase9:37557] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37557 2023-02-12 00:03:50,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/info/2a3bc7aa2d73422cb71722b2ac7a7b34 2023-02-12 00:03:50,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a3bc7aa2d73422cb71722b2ac7a7b34 2023-02-12 00:03:50,110 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:50,110 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:50,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/.tmp/info/61f93b6516a64c03be2f19115824b0bd 2023-02-12 00:03:50,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/.tmp/info/61f93b6516a64c03be2f19115824b0bd as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/info/61f93b6516a64c03be2f19115824b0bd 2023-02-12 00:03:50,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/info/61f93b6516a64c03be2f19115824b0bd, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 00:03:50,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f6bb401da1a03020d481b552924a531e in 80ms, sequenceid=6, compaction requested=false 2023-02-12 00:03:50,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/rep_barrier/d410ce24ae0349d9bbfe5ac3ca94a8c6 2023-02-12 00:03:50,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d410ce24ae0349d9bbfe5ac3ca94a8c6 2023-02-12 00:03:50,161 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:50,161 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37557,1676160224670 2023-02-12 00:03:50,161 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:50,161 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:50,163 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2356e8db rejected from java.util.concurrent.ThreadPoolExecutor@27696869[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,163 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:50,163 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47c7ac7f rejected from java.util.concurrent.ThreadPoolExecutor@27696869[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,163 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37557,1676160224670] 2023-02-12 00:03:50,163 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37557,1676160224670; numProcessing=1 2023-02-12 00:03:50,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/namespace/f6bb401da1a03020d481b552924a531e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 00:03:50,165 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37557,1676160224670 already deleted, retry=false 2023-02-12 00:03:50,165 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37557,1676160224670 expired; onlineServers=1 2023-02-12 00:03:50,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:50,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f6bb401da1a03020d481b552924a531e: Waiting for close lock at 1676160230063Running coprocessor pre-close hooks at 1676160230063Disabling compacts and flushes for region at 1676160230063Disabling writes for close at 1676160230063Obtaining lock to block concurrent updates at 1676160230064 (+1 ms)Preparing flush snapshotting stores in f6bb401da1a03020d481b552924a531e at 1676160230064Finished memstore snapshotting hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676160230064Flushing stores of hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. at 1676160230064Flushing f6bb401da1a03020d481b552924a531e/info: creating writer at 1676160230064Flushing f6bb401da1a03020d481b552924a531e/info: appending metadata at 1676160230078 (+14 ms)Flushing f6bb401da1a03020d481b552924a531e/info: closing flushed file at 1676160230078Flushing f6bb401da1a03020d481b552924a531e/info: reopening flushed file at 1676160230134 (+56 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f6bb401da1a03020d481b552924a531e in 80ms, sequenceid=6, compaction requested=false at 1676160230145 (+11 ms)Writing region close event to WAL at 1676160230147 (+2 ms)Running coprocessor post-close hooks at 1676160230165 (+18 ms)Closed at 1676160230176 (+11 ms) 2023-02-12 00:03:50,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676160225294.f6bb401da1a03020d481b552924a531e. 2023-02-12 00:03:50,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/table/a07c0631437c434798c96173283ec888 2023-02-12 00:03:50,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a07c0631437c434798c96173283ec888 2023-02-12 00:03:50,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/info/2a3bc7aa2d73422cb71722b2ac7a7b34 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/info/2a3bc7aa2d73422cb71722b2ac7a7b34 2023-02-12 00:03:50,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a3bc7aa2d73422cb71722b2ac7a7b34 2023-02-12 00:03:50,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/info/2a3bc7aa2d73422cb71722b2ac7a7b34, entries=12, sequenceid=21, filesize=6.2 K 2023-02-12 00:03:50,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/rep_barrier/d410ce24ae0349d9bbfe5ac3ca94a8c6 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/rep_barrier/d410ce24ae0349d9bbfe5ac3ca94a8c6 2023-02-12 00:03:50,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d410ce24ae0349d9bbfe5ac3ca94a8c6 2023-02-12 00:03:50,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/rep_barrier/d410ce24ae0349d9bbfe5ac3ca94a8c6, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 00:03:50,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/.tmp/table/a07c0631437c434798c96173283ec888 as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/table/a07c0631437c434798c96173283ec888 2023-02-12 00:03:50,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a07c0631437c434798c96173283ec888 2023-02-12 00:03:50,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/table/a07c0631437c434798c96173283ec888, entries=4, sequenceid=21, filesize=5.0 K 2023-02-12 00:03:50,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 148ms, sequenceid=21, compaction requested=false 2023-02-12 00:03:50,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 00:03:50,231 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 00:03:50,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:50,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676160230063Running coprocessor pre-close hooks at 1676160230063Disabling compacts and flushes for region at 1676160230063Disabling writes for close at 1676160230063Obtaining lock to block concurrent updates at 1676160230063Preparing flush snapshotting stores in 1588230740 at 1676160230063Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676160230064 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676160230064Flushing 1588230740/info: creating writer at 1676160230065 (+1 ms)Flushing 1588230740/info: appending metadata at 1676160230072 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676160230072Flushing 1588230740/rep_barrier: creating writer at 1676160230101 (+29 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676160230117 (+16 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676160230117Flushing 1588230740/table: creating writer at 1676160230151 (+34 ms)Flushing 1588230740/table: appending metadata at 1676160230153 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676160230153Flushing 1588230740/info: reopening flushed file at 1676160230187 (+34 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676160230199 (+12 ms)Flushing 1588230740/table: reopening flushed file at 1676160230204 (+5 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 148ms, sequenceid=21, compaction requested=false at 1676160230211 (+7 ms)Writing region close event to WAL at 1676160230219 (+8 ms)Running coprocessor post-close hooks at 1676160230230 (+11 ms)Closed at 1676160230232 (+2 ms) 2023-02-12 00:03:50,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 00:03:50,264 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37957,1676160224699; all regions closed. 2023-02-12 00:03:50,264 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,265 INFO [RS:0;jenkins-hbase9:37557] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37557,1676160224670; zookeeper connection closed. 2023-02-12 00:03:50,265 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f05944d rejected from java.util.concurrent.ThreadPoolExecutor@27696869[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,265 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37557-0x10045d82d410001, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,265 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@789afdcc rejected from java.util.concurrent.ThreadPoolExecutor@27696869[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,265 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@23ceb147] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@23ceb147 2023-02-12 00:03:50,269 DEBUG [RS:1;jenkins-hbase9:37957] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs 2023-02-12 00:03:50,269 INFO [RS:1;jenkins-hbase9:37957] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37957%2C1676160224699.meta:.meta(num 1676160225247) 2023-02-12 00:03:50,275 DEBUG [RS:1;jenkins-hbase9:37957] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/oldWALs 2023-02-12 00:03:50,275 INFO [RS:1;jenkins-hbase9:37957] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37957%2C1676160224699:(num 1676160225642) 2023-02-12 00:03:50,275 DEBUG [RS:1;jenkins-hbase9:37957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,275 INFO [RS:1;jenkins-hbase9:37957] regionserver.LeaseManager(133): Closed leases 2023-02-12 00:03:50,276 INFO [RS:1;jenkins-hbase9:37957] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 00:03:50,276 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:50,279 INFO [RS:1;jenkins-hbase9:37957] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37957 2023-02-12 00:03:50,281 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37957,1676160224699 2023-02-12 00:03:50,281 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 00:03:50,281 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a766a26 rejected from java.util.concurrent.ThreadPoolExecutor@6e49f3b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,284 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37957,1676160224699] 2023-02-12 00:03:50,284 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37957,1676160224699; numProcessing=2 2023-02-12 00:03:50,285 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37957,1676160224699 already deleted, retry=false 2023-02-12 00:03:50,285 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37957,1676160224699 expired; onlineServers=0 2023-02-12 00:03:50,285 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,33733,1676160224613' ***** 2023-02-12 00:03:50,285 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 00:03:50,286 DEBUG [M:0;jenkins-hbase9:33733] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5088eacf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-12 00:03:50,287 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,33733,1676160224613 2023-02-12 00:03:50,287 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,33733,1676160224613; all regions closed. 2023-02-12 00:03:50,287 DEBUG [M:0;jenkins-hbase9:33733] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 00:03:50,287 DEBUG [M:0;jenkins-hbase9:33733] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 00:03:50,287 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 00:03:50,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160224844] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676160224844,5,FailOnTimeoutGroup] 2023-02-12 00:03:50,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160224844] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676160224844,5,FailOnTimeoutGroup] 2023-02-12 00:03:50,287 DEBUG [M:0;jenkins-hbase9:33733] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 00:03:50,289 INFO [M:0;jenkins-hbase9:33733] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 00:03:50,289 INFO [M:0;jenkins-hbase9:33733] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 00:03:50,289 INFO [M:0;jenkins-hbase9:33733] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-12 00:03:50,289 DEBUG [M:0;jenkins-hbase9:33733] master.HMaster(1502): Stopping service threads 2023-02-12 00:03:50,289 INFO [M:0;jenkins-hbase9:33733] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 00:03:50,289 ERROR [M:0;jenkins-hbase9:33733] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 00:03:50,289 INFO [M:0;jenkins-hbase9:33733] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 00:03:50,289 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 00:03:50,290 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 00:03:50,290 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 00:03:50,290 DEBUG [M:0;jenkins-hbase9:33733] zookeeper.ZKUtil(398): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 00:03:50,290 WARN [M:0;jenkins-hbase9:33733] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 00:03:50,290 INFO [M:0;jenkins-hbase9:33733] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 00:03:50,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 00:03:50,292 INFO [M:0;jenkins-hbase9:33733] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 00:03:50,292 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 00:03:50,292 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:50,292 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:50,292 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 00:03:50,292 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:50,293 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-12 00:03:50,306 INFO [M:0;jenkins-hbase9:33733] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/59c7d572571c44188adc207ee461744c 2023-02-12 00:03:50,312 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/59c7d572571c44188adc207ee461744c as hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/59c7d572571c44188adc207ee461744c 2023-02-12 00:03:50,316 INFO [M:0;jenkins-hbase9:33733] regionserver.HStore(1080): Added hdfs://localhost:46333/user/jenkins/test-data/cdfa6034-9a2c-9c68-528c-34bc520d51a4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/59c7d572571c44188adc207ee461744c, entries=17, sequenceid=132, filesize=8.6 K 2023-02-12 00:03:50,317 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-12 00:03:50,318 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 00:03:50,318 DEBUG [M:0;jenkins-hbase9:33733] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676160230292Disabling compacts and flushes for region at 1676160230292Disabling writes for close at 1676160230292Obtaining lock to block concurrent updates at 1676160230293 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676160230293Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56025, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1676160230293Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676160230294 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676160230294Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676160230296 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676160230296Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676160230312 (+16 ms)Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false at 1676160230317 (+5 ms)Writing region close event to WAL at 1676160230318 (+1 ms)Closed at 1676160230318 2023-02-12 00:03:50,325 INFO [M:0;jenkins-hbase9:33733] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 00:03:50,325 INFO [M:0;jenkins-hbase9:33733] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33733 2023-02-12 00:03:50,325 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 00:03:50,327 DEBUG [M:0;jenkins-hbase9:33733] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,33733,1676160224613 already deleted, retry=false 2023-02-12 00:03:50,459 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,459 INFO [M:0;jenkins-hbase9:33733] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,33733,1676160224613; zookeeper connection closed. 2023-02-12 00:03:50,459 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@132c3b9 rejected from java.util.concurrent.ThreadPoolExecutor@50d4747[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,460 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): master:33733-0x10045d82d410000, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,460 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66bdc120 rejected from java.util.concurrent.ThreadPoolExecutor@50d4747[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,559 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,559 INFO [RS:1;jenkins-hbase9:37957] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37957,1676160224699; zookeeper connection closed. 2023-02-12 00:03:50,559 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43d49a2c rejected from java.util.concurrent.ThreadPoolExecutor@6e49f3b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,560 DEBUG [Listener at localhost/41691-EventThread] zookeeper.ZKWatcher(600): regionserver:37957-0x10045d82d410002, quorum=127.0.0.1:49276, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 00:03:50,560 ERROR [Listener at localhost/41691-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bdf4bbc rejected from java.util.concurrent.ThreadPoolExecutor@6e49f3b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 00:03:50,560 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d82b85] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d82b85 2023-02-12 00:03:50,560 INFO [Listener at localhost/41691] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 00:03:50,560 WARN [Listener at localhost/41691] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:50,570 INFO [Listener at localhost/41691] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:50,585 WARN [BP-2097255612-172.31.2.10-1676160224023 heartbeating to localhost/127.0.0.1:46333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2097255612-172.31.2.10-1676160224023 (Datanode Uuid 5d5a87e3-874e-46ce-b445-9ec934b0e084) service to localhost/127.0.0.1:46333 2023-02-12 00:03:50,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/dfs/data/data3/current/BP-2097255612-172.31.2.10-1676160224023] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:50,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/dfs/data/data4/current/BP-2097255612-172.31.2.10-1676160224023] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:50,676 WARN [Listener at localhost/41691] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 00:03:50,680 INFO [Listener at localhost/41691] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:50,781 WARN [BP-2097255612-172.31.2.10-1676160224023 heartbeating to localhost/127.0.0.1:46333] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 00:03:50,782 WARN [BP-2097255612-172.31.2.10-1676160224023 heartbeating to localhost/127.0.0.1:46333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2097255612-172.31.2.10-1676160224023 (Datanode Uuid fdfce115-4eb7-4c53-be04-39a50e7f37f5) service to localhost/127.0.0.1:46333 2023-02-12 00:03:50,782 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/dfs/data/data1/current/BP-2097255612-172.31.2.10-1676160224023] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:50,783 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cbd07a5e-f386-3ce2-63e5-1aa305a73239/cluster_486236be-6e27-6aee-d37d-91368ff86744/dfs/data/data2/current/BP-2097255612-172.31.2.10-1676160224023] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 00:03:50,798 INFO [Listener at localhost/41691] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 00:03:50,914 INFO [Listener at localhost/41691] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 00:03:50,932 INFO [Listener at localhost/41691] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 00:03:50,947 INFO [Listener at localhost/41691] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 274) Potentially hanging thread: Listener at localhost/41691 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:46333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,33733,1676160224613)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46333 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:46333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46333 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46333 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1195982799) connection to localhost/127.0.0.1:46333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=593 (was 578) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 244), ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=8681 (was 9339)