2023-02-16 09:00:08,555 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-16 09:00:08,601 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=141, ProcessCount=167, AvailableMemoryMB=3697 2023-02-16 09:00:08,903 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5 2023-02-16 09:00:08,911 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:08,912 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1, deleteOnExit=true 2023-02-16 09:00:08,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:08,912 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/test.cache.data in system properties and HBase conf 2023-02-16 09:00:08,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:08,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:08,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:08,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:08,914 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:09,033 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-16 09:00:09,433 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:09,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:09,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:09,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:09,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:09,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:09,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:09,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:09,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:09,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:09,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:09,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:09,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:09,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:09,444 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:09,992 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:09,999 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:10,354 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-16 09:00:10,539 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-16 09:00:10,555 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:10,603 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:10,643 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/java.io.tmpdir/Jetty_localhost_36075_hdfs____w2fgqd/webapp 2023-02-16 09:00:10,795 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36075 2023-02-16 09:00:10,807 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:10,808 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:11,368 WARN [Listener at localhost/43143] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:11,465 WARN [Listener at localhost/43143] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:11,487 WARN [Listener at localhost/43143] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:11,495 INFO [Listener at localhost/43143] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:11,501 INFO [Listener at localhost/43143] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/java.io.tmpdir/Jetty_localhost_36291_datanode____.j3vmdu/webapp 2023-02-16 09:00:11,619 INFO [Listener at localhost/43143] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36291 2023-02-16 09:00:12,069 WARN [Listener at localhost/45551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:12,102 WARN [Listener at localhost/45551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:12,107 WARN [Listener at localhost/45551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:12,109 INFO [Listener at localhost/45551] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:12,116 INFO [Listener at localhost/45551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/java.io.tmpdir/Jetty_localhost_37281_datanode____.j6u9jm/webapp 2023-02-16 09:00:12,249 INFO [Listener at localhost/45551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37281 2023-02-16 09:00:12,259 WARN [Listener at localhost/33963] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:12,630 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x811213dcfbf32bf3: Processing first storage report for DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2 from datanode 8beb116f-7e45-43f9-80b1-4b83d43c9a0e 2023-02-16 09:00:12,632 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x811213dcfbf32bf3: from storage DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2 node DatanodeRegistration(127.0.0.1:40735, datanodeUuid=8beb116f-7e45-43f9-80b1-4b83d43c9a0e, infoPort=37819, infoSecurePort=0, ipcPort=33963, storageInfo=lv=-57;cid=testClusterID;nsid=136390;c=1676538010101), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-16 09:00:12,632 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb72261c91068143b: Processing first storage report for DS-898dd362-a93f-4d63-bd26-a3b63cf39720 from datanode c3f502bf-109e-41fd-b69d-86f9d9f50211 2023-02-16 09:00:12,632 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb72261c91068143b: from storage DS-898dd362-a93f-4d63-bd26-a3b63cf39720 node DatanodeRegistration(127.0.0.1:40229, datanodeUuid=c3f502bf-109e-41fd-b69d-86f9d9f50211, infoPort=33033, infoSecurePort=0, ipcPort=45551, storageInfo=lv=-57;cid=testClusterID;nsid=136390;c=1676538010101), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:12,633 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x811213dcfbf32bf3: Processing first storage report for DS-7199a252-d23a-4eed-bf5a-096ff7ed4146 from datanode 8beb116f-7e45-43f9-80b1-4b83d43c9a0e 2023-02-16 09:00:12,633 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x811213dcfbf32bf3: from storage DS-7199a252-d23a-4eed-bf5a-096ff7ed4146 node DatanodeRegistration(127.0.0.1:40735, datanodeUuid=8beb116f-7e45-43f9-80b1-4b83d43c9a0e, infoPort=37819, infoSecurePort=0, ipcPort=33963, storageInfo=lv=-57;cid=testClusterID;nsid=136390;c=1676538010101), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:12,633 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb72261c91068143b: Processing first storage report for DS-b386f1ec-fcae-4f36-a246-4e84c3397ab5 from datanode c3f502bf-109e-41fd-b69d-86f9d9f50211 2023-02-16 09:00:12,633 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb72261c91068143b: from storage DS-b386f1ec-fcae-4f36-a246-4e84c3397ab5 node DatanodeRegistration(127.0.0.1:40229, datanodeUuid=c3f502bf-109e-41fd-b69d-86f9d9f50211, infoPort=33033, infoSecurePort=0, ipcPort=45551, storageInfo=lv=-57;cid=testClusterID;nsid=136390;c=1676538010101), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:12,737 DEBUG [Listener at localhost/33963] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5 2023-02-16 09:00:12,855 INFO [Listener at localhost/33963] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/zookeeper_0, clientPort=57354, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:12,875 INFO [Listener at localhost/33963] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57354 2023-02-16 09:00:12,887 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:12,890 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:13,573 INFO [Listener at localhost/33963] util.FSUtils(479): Created version file at hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5 with version=8 2023-02-16 09:00:13,574 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:13,575 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:13,579 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/hbase-staging 2023-02-16 09:00:13,912 INFO [Listener at localhost/33963] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-16 09:00:14,373 INFO [Listener at localhost/33963] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:14,407 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,408 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,408 INFO [Listener at localhost/33963] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:14,408 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,408 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:14,548 INFO [Listener at localhost/33963] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:14,625 DEBUG [Listener at localhost/33963] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-16 09:00:14,716 INFO [Listener at localhost/33963] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40701 2023-02-16 09:00:14,726 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:14,728 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:14,750 INFO [Listener at localhost/33963] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40701 connecting to ZooKeeper ensemble=127.0.0.1:57354 2023-02-16 09:00:14,806 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:407010x0, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:14,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40701-0x1005c5bce620000 connected 2023-02-16 09:00:14,842 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:14,843 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:14,846 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:14,855 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-16 09:00:14,855 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40701 2023-02-16 09:00:14,856 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40701 2023-02-16 09:00:14,856 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-16 09:00:14,856 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-16 09:00:14,863 INFO [Listener at localhost/33963] master.HMaster(444): hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5, hbase.cluster.distributed=false 2023-02-16 09:00:14,935 INFO [Listener at localhost/33963] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:14,935 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,935 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,936 INFO [Listener at localhost/33963] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:14,936 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,936 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:14,941 INFO [Listener at localhost/33963] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:14,944 INFO [Listener at localhost/33963] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43123 2023-02-16 09:00:14,946 INFO [Listener at localhost/33963] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:14,954 DEBUG [Listener at localhost/33963] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:14,955 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:14,957 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:14,959 INFO [Listener at localhost/33963] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43123 connecting to ZooKeeper ensemble=127.0.0.1:57354 2023-02-16 09:00:14,965 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:431230x0, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:14,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43123-0x1005c5bce620001 connected 2023-02-16 09:00:14,966 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:14,968 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:14,969 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:14,972 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43123 2023-02-16 09:00:14,976 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43123 2023-02-16 09:00:14,976 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43123 2023-02-16 09:00:14,977 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43123 2023-02-16 09:00:14,978 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43123 2023-02-16 09:00:14,997 INFO [Listener at localhost/33963] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:14,997 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,997 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,998 INFO [Listener at localhost/33963] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:14,998 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:14,999 INFO [Listener at localhost/33963] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:14,999 INFO [Listener at localhost/33963] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:15,001 INFO [Listener at localhost/33963] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44467 2023-02-16 09:00:15,001 INFO [Listener at localhost/33963] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:15,008 DEBUG [Listener at localhost/33963] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:15,009 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:15,013 INFO [Listener at localhost/33963] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:15,015 INFO [Listener at localhost/33963] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44467 connecting to ZooKeeper ensemble=127.0.0.1:57354 2023-02-16 09:00:15,021 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:444670x0, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:15,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44467-0x1005c5bce620002 connected 2023-02-16 09:00:15,023 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:15,024 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:15,024 DEBUG [Listener at localhost/33963] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:15,027 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44467 2023-02-16 09:00:15,028 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44467 2023-02-16 09:00:15,028 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44467 2023-02-16 09:00:15,032 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44467 2023-02-16 09:00:15,036 DEBUG [Listener at localhost/33963] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44467 2023-02-16 09:00:15,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,047 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:15,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,069 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:15,069 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:15,069 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:15,069 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:15,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40701,1676538013734 from backup master directory 2023-02-16 09:00:15,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:15,075 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,075 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:15,076 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:15,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-16 09:00:15,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-16 09:00:15,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/hbase.id with ID: 78cfc36a-97d5-4c0c-9a8d-28069692ad5b 2023-02-16 09:00:15,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:15,238 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7815781e to 127.0.0.1:57354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:15,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b735bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:15,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:15,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:15,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-16 09:00:15,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-16 09:00:15,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 09:00:15,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 09:00:15,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:15,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store-tmp 2023-02-16 09:00:15,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:15,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:15,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:15,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:15,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:15,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:15,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:15,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:15,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/WALs/jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40701%2C1676538013734, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/WALs/jenkins-hbase4.apache.org,40701,1676538013734, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:15,521 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK] 2023-02-16 09:00:15,521 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK] 2023-02-16 09:00:15,529 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-16 09:00:15,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/WALs/jenkins-hbase4.apache.org,40701,1676538013734/jenkins-hbase4.apache.org%2C40701%2C1676538013734.1676538015477 2023-02-16 09:00:15,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK]] 2023-02-16 09:00:15,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:15,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:15,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,660 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,666 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:15,694 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:15,705 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:15,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:15,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65518226, jitterRate=-0.023702353239059448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:15,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:15,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:15,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:15,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:15,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:15,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-16 09:00:15,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-16 09:00:15,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:15,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:15,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:15,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:15,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:15,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:15,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:15,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:15,873 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:15,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:15,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:15,898 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:15,898 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:15,898 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,898 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:15,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40701,1676538013734, sessionid=0x1005c5bce620000, setting cluster-up flag (Was=false) 2023-02-16 09:00:15,919 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:15,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,935 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:15,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:15,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:15,945 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/.tmp 2023-02-16 09:00:16,040 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(952): ClusterId : 78cfc36a-97d5-4c0c-9a8d-28069692ad5b 2023-02-16 09:00:16,040 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(952): ClusterId : 78cfc36a-97d5-4c0c-9a8d-28069692ad5b 2023-02-16 09:00:16,048 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:16,048 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:16,056 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:16,056 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:16,056 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:16,056 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:16,060 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:16,060 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:16,061 DEBUG [RS:1;jenkins-hbase4:44467] zookeeper.ReadOnlyZKClient(139): Connect 0x7dad7058 to 127.0.0.1:57354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:16,061 DEBUG [RS:0;jenkins-hbase4:43123] zookeeper.ReadOnlyZKClient(139): Connect 0x03b1a199 to 127.0.0.1:57354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:16,074 DEBUG [RS:1;jenkins-hbase4:44467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@736a819d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:16,075 DEBUG [RS:0;jenkins-hbase4:43123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d764f9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:16,076 DEBUG [RS:1;jenkins-hbase4:44467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77551b28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:16,076 DEBUG [RS:0;jenkins-hbase4:43123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@949cae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:16,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:16,098 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43123 2023-02-16 09:00:16,098 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44467 2023-02-16 09:00:16,102 INFO [RS:0;jenkins-hbase4:43123] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:16,102 INFO [RS:1;jenkins-hbase4:44467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:16,103 INFO [RS:0;jenkins-hbase4:43123] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:16,103 INFO [RS:1;jenkins-hbase4:44467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:16,103 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:16,103 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:16,106 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40701,1676538013734 with isa=jenkins-hbase4.apache.org/172.31.14.131:43123, startcode=1676538014934 2023-02-16 09:00:16,106 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40701,1676538013734 with isa=jenkins-hbase4.apache.org/172.31.14.131:44467, startcode=1676538014996 2023-02-16 09:00:16,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:16,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538046121 2023-02-16 09:00:16,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:16,124 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:16,125 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:16,129 DEBUG [RS:1;jenkins-hbase4:44467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:16,129 DEBUG [RS:0;jenkins-hbase4:43123] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:16,130 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:16,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:16,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:16,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:16,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:16,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:16,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:16,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:16,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:16,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:16,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:16,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538016155,5,FailOnTimeoutGroup] 2023-02-16 09:00:16,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538016156,5,FailOnTimeoutGroup] 2023-02-16 09:00:16,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:16,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,184 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:16,186 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:16,187 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5 2023-02-16 09:00:16,214 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:16,215 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38159, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:16,215 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54917, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:16,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:16,221 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/info 2023-02-16 09:00:16,222 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:16,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:16,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:16,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:16,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:16,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/table 2023-02-16 09:00:16,232 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:16,232 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,236 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740 2023-02-16 09:00:16,237 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740 2023-02-16 09:00:16,242 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:16,245 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:16,249 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:16,249 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5 2023-02-16 09:00:16,249 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5 2023-02-16 09:00:16,250 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43143 2023-02-16 09:00:16,250 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43143 2023-02-16 09:00:16,250 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:16,250 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:16,250 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66343199, jitterRate=-0.011409297585487366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:16,250 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:16,250 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:16,250 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:16,250 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:16,250 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:16,251 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:16,252 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:16,252 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:16,260 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:16,260 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:16,261 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:16,261 DEBUG [RS:1;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,262 DEBUG [RS:0;jenkins-hbase4:43123] zookeeper.ZKUtil(162): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,262 WARN [RS:1;jenkins-hbase4:44467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:16,262 WARN [RS:0;jenkins-hbase4:43123] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:16,262 INFO [RS:1;jenkins-hbase4:44467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:16,263 INFO [RS:0;jenkins-hbase4:43123] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:16,263 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,263 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,263 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43123,1676538014934] 2023-02-16 09:00:16,263 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44467,1676538014996] 2023-02-16 09:00:16,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:16,276 DEBUG [RS:0;jenkins-hbase4:43123] zookeeper.ZKUtil(162): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,277 DEBUG [RS:1;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,277 DEBUG [RS:1;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,277 DEBUG [RS:0;jenkins-hbase4:43123] zookeeper.ZKUtil(162): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,287 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:16,290 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:16,290 DEBUG [RS:0;jenkins-hbase4:43123] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:16,290 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:16,300 INFO [RS:0;jenkins-hbase4:43123] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:16,300 INFO [RS:1;jenkins-hbase4:44467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:16,321 INFO [RS:0;jenkins-hbase4:43123] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:16,321 INFO [RS:1;jenkins-hbase4:44467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:16,326 INFO [RS:0;jenkins-hbase4:43123] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:16,326 INFO [RS:1;jenkins-hbase4:44467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:16,326 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,326 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,327 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:16,327 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:16,336 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,336 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,337 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,337 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,337 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,337 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,337 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,338 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,339 DEBUG [RS:0;jenkins-hbase4:43123] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,339 DEBUG [RS:1;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:16,341 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,341 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,341 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,341 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,342 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,342 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,361 INFO [RS:0;jenkins-hbase4:43123] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:16,361 INFO [RS:1;jenkins-hbase4:44467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:16,365 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43123,1676538014934-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,365 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44467,1676538014996-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,389 INFO [RS:1;jenkins-hbase4:44467] regionserver.Replication(203): jenkins-hbase4.apache.org,44467,1676538014996 started 2023-02-16 09:00:16,389 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44467,1676538014996, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44467, sessionid=0x1005c5bce620002 2023-02-16 09:00:16,392 INFO [RS:0;jenkins-hbase4:43123] regionserver.Replication(203): jenkins-hbase4.apache.org,43123,1676538014934 started 2023-02-16 09:00:16,392 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43123,1676538014934, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43123, sessionid=0x1005c5bce620001 2023-02-16 09:00:16,392 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:16,392 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:16,392 DEBUG [RS:1;jenkins-hbase4:44467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,392 DEBUG [RS:0;jenkins-hbase4:43123] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,393 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44467,1676538014996' 2023-02-16 09:00:16,393 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43123,1676538014934' 2023-02-16 09:00:16,394 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:16,394 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:16,395 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:16,395 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:16,395 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:16,395 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:16,395 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:16,396 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:16,396 DEBUG [RS:1;jenkins-hbase4:44467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,396 DEBUG [RS:0;jenkins-hbase4:43123] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:16,396 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44467,1676538014996' 2023-02-16 09:00:16,396 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:16,396 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43123,1676538014934' 2023-02-16 09:00:16,397 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:16,397 DEBUG [RS:1;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:16,397 DEBUG [RS:0;jenkins-hbase4:43123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:16,398 DEBUG [RS:1;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:16,398 DEBUG [RS:0;jenkins-hbase4:43123] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:16,398 INFO [RS:1;jenkins-hbase4:44467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:16,398 INFO [RS:0;jenkins-hbase4:43123] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:16,399 INFO [RS:1;jenkins-hbase4:44467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:16,399 INFO [RS:0;jenkins-hbase4:43123] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:16,442 DEBUG [jenkins-hbase4:40701] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:16,448 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:16,455 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:16,455 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:16,455 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:16,458 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44467,1676538014996, state=OPENING 2023-02-16 09:00:16,466 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:16,468 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:16,469 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:16,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:16,662 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:16,664 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:16,668 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:16,682 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:16,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:16,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44467%2C1676538014996.meta, suffix=.meta, logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,44467,1676538014996, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs, maxLogs=32 2023-02-16 09:00:16,706 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK] 2023-02-16 09:00:16,706 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK] 2023-02-16 09:00:16,711 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,44467,1676538014996/jenkins-hbase4.apache.org%2C44467%2C1676538014996.meta.1676538016689.meta 2023-02-16 09:00:16,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK]] 2023-02-16 09:00:16,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:16,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:16,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:16,736 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:16,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:16,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:16,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:16,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:16,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:16,747 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/info 2023-02-16 09:00:16,747 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/info 2023-02-16 09:00:16,748 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:16,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:16,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:16,751 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:16,751 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:16,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:16,754 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/table 2023-02-16 09:00:16,754 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/table 2023-02-16 09:00:16,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:16,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:16,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740 2023-02-16 09:00:16,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740 2023-02-16 09:00:16,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:16,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:16,768 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73639572, jitterRate=0.09731513261795044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:16,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:16,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538016653 2023-02-16 09:00:16,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:16,801 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:16,801 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44467,1676538014996, state=OPEN 2023-02-16 09:00:16,804 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:16,805 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:16,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:16,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44467,1676538014996 in 332 msec 2023-02-16 09:00:16,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:16,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 537 msec 2023-02-16 09:00:16,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 807 msec 2023-02-16 09:00:16,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538016819, completionTime=-1 2023-02-16 09:00:16,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:16,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:16,886 DEBUG [hconnection-0x45eae7f1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:16,889 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538076912 2023-02-16 09:00:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538136912 2023-02-16 09:00:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 92 msec 2023-02-16 09:00:16,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1676538013734-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1676538013734-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1676538013734-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40701, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:16,945 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:16,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:16,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:16,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:16,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:16,972 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:16,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:16,997 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6 empty. 2023-02-16 09:00:16,997 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:16,997 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:17,026 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:17,028 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a40b0ca3096d2168e61a22a6a76567f6, NAME => 'hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:17,049 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:17,049 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a40b0ca3096d2168e61a22a6a76567f6, disabling compactions & flushes 2023-02-16 09:00:17,049 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,049 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. after waiting 0 ms 2023-02-16 09:00:17,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,050 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a40b0ca3096d2168e61a22a6a76567f6: 2023-02-16 09:00:17,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:17,075 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538017057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538017057"}]},"ts":"1676538017057"} 2023-02-16 09:00:17,111 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:17,113 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:17,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538017113"}]},"ts":"1676538017113"} 2023-02-16 09:00:17,123 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:17,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:17,129 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:17,129 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:17,129 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:17,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a40b0ca3096d2168e61a22a6a76567f6, ASSIGN}] 2023-02-16 09:00:17,134 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a40b0ca3096d2168e61a22a6a76567f6, ASSIGN 2023-02-16 09:00:17,136 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a40b0ca3096d2168e61a22a6a76567f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:17,289 INFO [jenkins-hbase4:40701] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:17,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a40b0ca3096d2168e61a22a6a76567f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:17,290 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538017289"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538017289"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538017289"}]},"ts":"1676538017289"} 2023-02-16 09:00:17,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a40b0ca3096d2168e61a22a6a76567f6, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:17,410 INFO [RS:0;jenkins-hbase4:43123] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43123%2C1676538014934, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,43123,1676538014934, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs, maxLogs=32 2023-02-16 09:00:17,411 INFO [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44467%2C1676538014996, suffix=, logDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,44467,1676538014996, archiveDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs, maxLogs=32 2023-02-16 09:00:17,431 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK] 2023-02-16 09:00:17,431 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK] 2023-02-16 09:00:17,432 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK] 2023-02-16 09:00:17,432 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK] 2023-02-16 09:00:17,435 INFO [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,44467,1676538014996/jenkins-hbase4.apache.org%2C44467%2C1676538014996.1676538017413 2023-02-16 09:00:17,439 DEBUG [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK], DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK]] 2023-02-16 09:00:17,439 INFO [RS:0;jenkins-hbase4:43123] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/WALs/jenkins-hbase4.apache.org,43123,1676538014934/jenkins-hbase4.apache.org%2C43123%2C1676538014934.1676538017412 2023-02-16 09:00:17,440 DEBUG [RS:0;jenkins-hbase4:43123] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40229,DS-898dd362-a93f-4d63-bd26-a3b63cf39720,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-2fd3bdac-6f35-48c8-abd3-22728bb939b2,DISK]] 2023-02-16 09:00:17,456 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a40b0ca3096d2168e61a22a6a76567f6, NAME => 'hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:17,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:17,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,464 INFO [StoreOpener-a40b0ca3096d2168e61a22a6a76567f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,467 DEBUG [StoreOpener-a40b0ca3096d2168e61a22a6a76567f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/info 2023-02-16 09:00:17,468 DEBUG [StoreOpener-a40b0ca3096d2168e61a22a6a76567f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/info 2023-02-16 09:00:17,468 INFO [StoreOpener-a40b0ca3096d2168e61a22a6a76567f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a40b0ca3096d2168e61a22a6a76567f6 columnFamilyName info 2023-02-16 09:00:17,469 INFO [StoreOpener-a40b0ca3096d2168e61a22a6a76567f6-1] regionserver.HStore(310): Store=a40b0ca3096d2168e61a22a6a76567f6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:17,470 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,476 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:17,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:17,480 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a40b0ca3096d2168e61a22a6a76567f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64870344, jitterRate=-0.033356547355651855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:17,480 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a40b0ca3096d2168e61a22a6a76567f6: 2023-02-16 09:00:17,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6., pid=6, masterSystemTime=1676538017448 2023-02-16 09:00:17,487 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,487 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:17,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a40b0ca3096d2168e61a22a6a76567f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:17,489 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538017488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538017488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538017488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538017488"}]},"ts":"1676538017488"} 2023-02-16 09:00:17,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:17,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a40b0ca3096d2168e61a22a6a76567f6, server=jenkins-hbase4.apache.org,44467,1676538014996 in 200 msec 2023-02-16 09:00:17,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:17,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a40b0ca3096d2168e61a22a6a76567f6, ASSIGN in 366 msec 2023-02-16 09:00:17,504 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:17,504 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538017504"}]},"ts":"1676538017504"} 2023-02-16 09:00:17,507 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:17,510 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:17,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 553 msec 2023-02-16 09:00:17,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:17,571 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:17,571 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:17,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:17,651 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:17,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-02-16 09:00:17,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:17,681 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:17,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-16 09:00:17,694 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:17,697 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:17,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.623sec 2023-02-16 09:00:17,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:17,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:17,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:17,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1676538013734-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:17,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1676538013734-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:17,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:17,751 DEBUG [Listener at localhost/33963] zookeeper.ReadOnlyZKClient(139): Connect 0x2fa4f0e5 to 127.0.0.1:57354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:17,767 DEBUG [Listener at localhost/33963] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73e8f434, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:17,804 DEBUG [hconnection-0x28cc1dd8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:17,818 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:17,830 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:17,830 DEBUG [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:17,839 DEBUG [Listener at localhost/33963] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:17,842 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:17,847 INFO [Listener at localhost/33963] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 09:00:17,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 09:00:17,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:43622 deadline: 1676538077850, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 09:00:17,870 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 09:00:17,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 09:00:17,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:17,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:17,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 09:00:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:17,914 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:17,914 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:17,914 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:17,914 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:17,915 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df empty. 2023-02-16 09:00:17,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 empty. 2023-02-16 09:00:17,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:17,920 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:17,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:17,920 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:17,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:17,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:17,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:17,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:17,922 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 empty. 2023-02-16 09:00:17,923 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 empty. 2023-02-16 09:00:17,923 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 empty. 2023-02-16 09:00:17,924 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a empty. 2023-02-16 09:00:17,924 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 empty. 2023-02-16 09:00:17,924 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:17,924 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:17,924 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:17,925 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 empty. 2023-02-16 09:00:17,925 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc empty. 2023-02-16 09:00:17,925 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 empty. 2023-02-16 09:00:17,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:17,925 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:17,926 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:17,926 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:17,926 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:17,926 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 09:00:17,969 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:17,973 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d1332b0816f9888e8fa4edc2b170d0df, NAME => 'testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:17,991 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f5ac0259d99c40e14d3716eefafea69a, NAME => 'testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:17,993 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => fbf11cf41308153e75b27da2f592df30, NAME => 'testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:18,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d1332b0816f9888e8fa4edc2b170d0df, disabling compactions & flushes 2023-02-16 09:00:18,068 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. after waiting 0 ms 2023-02-16 09:00:18,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,068 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:18,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d9822b0b282723ef68c00cdc9a37a226, NAME => 'testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing fbf11cf41308153e75b27da2f592df30, disabling compactions & flushes 2023-02-16 09:00:18,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. after waiting 0 ms 2023-02-16 09:00:18,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:18,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5b97478ff907745071a7a9f95dba17cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f5ac0259d99c40e14d3716eefafea69a, disabling compactions & flushes 2023-02-16 09:00:18,091 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. after waiting 0 ms 2023-02-16 09:00:18,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,091 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,091 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:18,092 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6caeee774f45951fb67e0c0d4996b856, NAME => 'testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d9822b0b282723ef68c00cdc9a37a226, disabling compactions & flushes 2023-02-16 09:00:18,126 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,126 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,126 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. after waiting 0 ms 2023-02-16 09:00:18,126 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,126 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,126 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:18,127 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e6c3b6d97d6db554bed480cdc72613c3, NAME => 'testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5b97478ff907745071a7a9f95dba17cc, disabling compactions & flushes 2023-02-16 09:00:18,128 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. after waiting 0 ms 2023-02-16 09:00:18,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,129 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:18,130 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a55f046d5df1fae99a3320b025fd2b02, NAME => 'testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6caeee774f45951fb67e0c0d4996b856, disabling compactions & flushes 2023-02-16 09:00:18,134 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. after waiting 0 ms 2023-02-16 09:00:18,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,134 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:18,135 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 34e164cd29b3c4105974b1975e2a19a2, NAME => 'testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e6c3b6d97d6db554bed480cdc72613c3, disabling compactions & flushes 2023-02-16 09:00:18,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a55f046d5df1fae99a3320b025fd2b02, disabling compactions & flushes 2023-02-16 09:00:18,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,160 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. after waiting 0 ms 2023-02-16 09:00:18,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. after waiting 0 ms 2023-02-16 09:00:18,160 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,161 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:18,161 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,161 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:18,162 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1781b02d9e51ff1c78ecaca8ce5a1581, NAME => 'testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp 2023-02-16 09:00:18,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 34e164cd29b3c4105974b1975e2a19a2, disabling compactions & flushes 2023-02-16 09:00:18,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. after waiting 0 ms 2023-02-16 09:00:18,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:18,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1781b02d9e51ff1c78ecaca8ce5a1581, disabling compactions & flushes 2023-02-16 09:00:18,181 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,181 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. after waiting 0 ms 2023-02-16 09:00:18,182 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,182 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,182 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:18,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:18,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,191 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538018188"}]},"ts":"1676538018188"} 2023-02-16 09:00:18,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:18,242 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 09:00:18,244 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:18,245 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538018244"}]},"ts":"1676538018244"} 2023-02-16 09:00:18,247 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 09:00:18,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:18,264 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:18,264 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:18,264 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:18,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, ASSIGN}] 2023-02-16 09:00:18,268 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, ASSIGN 2023-02-16 09:00:18,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, ASSIGN 2023-02-16 09:00:18,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, ASSIGN 2023-02-16 09:00:18,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, ASSIGN 2023-02-16 09:00:18,272 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:18,272 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43123,1676538014934; forceNewPlan=false, retain=false 2023-02-16 09:00:18,272 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:18,273 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, ASSIGN 2023-02-16 09:00:18,272 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43123,1676538014934; forceNewPlan=false, retain=false 2023-02-16 09:00:18,274 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, ASSIGN 2023-02-16 09:00:18,274 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:18,274 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, ASSIGN 2023-02-16 09:00:18,274 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, ASSIGN 2023-02-16 09:00:18,274 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, ASSIGN 2023-02-16 09:00:18,275 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:18,275 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, ASSIGN 2023-02-16 09:00:18,275 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1676538014996; forceNewPlan=false, retain=false 2023-02-16 09:00:18,275 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43123,1676538014934; forceNewPlan=false, retain=false 2023-02-16 09:00:18,276 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43123,1676538014934; forceNewPlan=false, retain=false 2023-02-16 09:00:18,276 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43123,1676538014934; forceNewPlan=false, retain=false 2023-02-16 09:00:18,423 INFO [jenkins-hbase4:40701] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 09:00:18,426 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1781b02d9e51ff1c78ecaca8ce5a1581, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,426 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a55f046d5df1fae99a3320b025fd2b02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6caeee774f45951fb67e0c0d4996b856, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,426 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d9822b0b282723ef68c00cdc9a37a226, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018426"}]},"ts":"1676538018426"} 2023-02-16 09:00:18,426 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fbf11cf41308153e75b27da2f592df30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018426"}]},"ts":"1676538018426"} 2023-02-16 09:00:18,427 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018426"}]},"ts":"1676538018426"} 2023-02-16 09:00:18,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018426"}]},"ts":"1676538018426"} 2023-02-16 09:00:18,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018426"}]},"ts":"1676538018426"} 2023-02-16 09:00:18,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 1781b02d9e51ff1c78ecaca8ce5a1581, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:18,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 6caeee774f45951fb67e0c0d4996b856, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:18,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure d9822b0b282723ef68c00cdc9a37a226, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:18,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure fbf11cf41308153e75b27da2f592df30, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:18,439 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5b97478ff907745071a7a9f95dba17cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018439"}]},"ts":"1676538018439"} 2023-02-16 09:00:18,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 5b97478ff907745071a7a9f95dba17cc, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:18,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure a55f046d5df1fae99a3320b025fd2b02, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:18,446 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=34e164cd29b3c4105974b1975e2a19a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f5ac0259d99c40e14d3716eefafea69a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,446 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018445"}]},"ts":"1676538018445"} 2023-02-16 09:00:18,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018445"}]},"ts":"1676538018445"} 2023-02-16 09:00:18,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 34e164cd29b3c4105974b1975e2a19a2, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:18,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e6c3b6d97d6db554bed480cdc72613c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018449"}]},"ts":"1676538018449"} 2023-02-16 09:00:18,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure f5ac0259d99c40e14d3716eefafea69a, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:18,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure e6c3b6d97d6db554bed480cdc72613c3, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:18,460 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d1332b0816f9888e8fa4edc2b170d0df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,461 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018460"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538018460"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538018460"}]},"ts":"1676538018460"} 2023-02-16 09:00:18,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure d1332b0816f9888e8fa4edc2b170d0df, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:18,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:18,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d9822b0b282723ef68c00cdc9a37a226, NAME => 'testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 09:00:18,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,596 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,598 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1 2023-02-16 09:00:18,598 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1 2023-02-16 09:00:18,598 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,598 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9822b0b282723ef68c00cdc9a37a226 columnFamilyName f1 2023-02-16 09:00:18,599 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:18,599 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(310): Store=d9822b0b282723ef68c00cdc9a37a226/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,612 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,613 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:18,615 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2 2023-02-16 09:00:18,615 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2 2023-02-16 09:00:18,615 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9822b0b282723ef68c00cdc9a37a226 columnFamilyName f2 2023-02-16 09:00:18,616 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(310): Store=d9822b0b282723ef68c00cdc9a37a226/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f5ac0259d99c40e14d3716eefafea69a, NAME => 'testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 09:00:18,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,624 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:18,628 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1 2023-02-16 09:00:18,628 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1 2023-02-16 09:00:18,629 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ac0259d99c40e14d3716eefafea69a columnFamilyName f1 2023-02-16 09:00:18,630 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(310): Store=f5ac0259d99c40e14d3716eefafea69a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,630 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,632 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2 2023-02-16 09:00:18,632 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2 2023-02-16 09:00:18,633 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ac0259d99c40e14d3716eefafea69a columnFamilyName f2 2023-02-16 09:00:18,634 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(310): Store=f5ac0259d99c40e14d3716eefafea69a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d9822b0b282723ef68c00cdc9a37a226; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62847153, jitterRate=-0.06350444257259369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:18,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226., pid=23, masterSystemTime=1676538018584 2023-02-16 09:00:18,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:18,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1781b02d9e51ff1c78ecaca8ce5a1581, NAME => 'testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 09:00:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,650 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d9822b0b282723ef68c00cdc9a37a226, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,650 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018650"}]},"ts":"1676538018650"} 2023-02-16 09:00:18,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:18,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-16 09:00:18,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, ASSIGN in 392 msec 2023-02-16 09:00:18,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure d9822b0b282723ef68c00cdc9a37a226, server=jenkins-hbase4.apache.org,44467,1676538014996 in 218 msec 2023-02-16 09:00:18,665 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f5ac0259d99c40e14d3716eefafea69a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64907098, jitterRate=-0.03280887007713318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:18,667 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f1 2023-02-16 09:00:18,667 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f1 2023-02-16 09:00:18,668 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1781b02d9e51ff1c78ecaca8ce5a1581 columnFamilyName f1 2023-02-16 09:00:18,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a., pid=28, masterSystemTime=1676538018598 2023-02-16 09:00:18,670 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(310): Store=1781b02d9e51ff1c78ecaca8ce5a1581/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,671 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:18,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1332b0816f9888e8fa4edc2b170d0df, NAME => 'testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 09:00:18,673 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f2 2023-02-16 09:00:18,673 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f2 2023-02-16 09:00:18,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f5ac0259d99c40e14d3716eefafea69a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,674 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1781b02d9e51ff1c78ecaca8ce5a1581 columnFamilyName f2 2023-02-16 09:00:18,675 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018674"}]},"ts":"1676538018674"} 2023-02-16 09:00:18,675 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(310): Store=1781b02d9e51ff1c78ecaca8ce5a1581/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,680 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,683 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f1 2023-02-16 09:00:18,683 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f1 2023-02-16 09:00:18,683 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1332b0816f9888e8fa4edc2b170d0df columnFamilyName f1 2023-02-16 09:00:18,684 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(310): Store=d1332b0816f9888e8fa4edc2b170d0df/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,685 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-16 09:00:18,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure f5ac0259d99c40e14d3716eefafea69a, server=jenkins-hbase4.apache.org,43123,1676538014934 in 232 msec 2023-02-16 09:00:18,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:18,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, ASSIGN in 422 msec 2023-02-16 09:00:18,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1781b02d9e51ff1c78ecaca8ce5a1581; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69937894, jitterRate=0.042155832052230835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:18,696 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f2 2023-02-16 09:00:18,696 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f2 2023-02-16 09:00:18,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581., pid=21, masterSystemTime=1676538018584 2023-02-16 09:00:18,697 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1332b0816f9888e8fa4edc2b170d0df columnFamilyName f2 2023-02-16 09:00:18,698 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(310): Store=d1332b0816f9888e8fa4edc2b170d0df/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,701 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1781b02d9e51ff1c78ecaca8ce5a1581, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6caeee774f45951fb67e0c0d4996b856, NAME => 'testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 09:00:18,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018701"}]},"ts":"1676538018701"} 2023-02-16 09:00:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,705 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,708 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1 2023-02-16 09:00:18,709 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1 2023-02-16 09:00:18,709 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6caeee774f45951fb67e0c0d4996b856 columnFamilyName f1 2023-02-16 09:00:18,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:18,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-16 09:00:18,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 1781b02d9e51ff1c78ecaca8ce5a1581, server=jenkins-hbase4.apache.org,44467,1676538014996 in 276 msec 2023-02-16 09:00:18,712 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(310): Store=6caeee774f45951fb67e0c0d4996b856/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,712 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, ASSIGN in 444 msec 2023-02-16 09:00:18,715 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2 2023-02-16 09:00:18,715 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2 2023-02-16 09:00:18,715 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6caeee774f45951fb67e0c0d4996b856 columnFamilyName f2 2023-02-16 09:00:18,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,716 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(310): Store=6caeee774f45951fb67e0c0d4996b856/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d1332b0816f9888e8fa4edc2b170d0df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59572478, jitterRate=-0.11230090260505676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:18,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df., pid=30, masterSystemTime=1676538018598 2023-02-16 09:00:18,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:18,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34e164cd29b3c4105974b1975e2a19a2, NAME => 'testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 09:00:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,722 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d1332b0816f9888e8fa4edc2b170d0df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,722 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538018722"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018722"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018722"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018722"}]},"ts":"1676538018722"} 2023-02-16 09:00:18,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:18,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-16 09:00:18,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure d1332b0816f9888e8fa4edc2b170d0df, server=jenkins-hbase4.apache.org,43123,1676538014934 in 262 msec 2023-02-16 09:00:18,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,732 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6caeee774f45951fb67e0c0d4996b856; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64149010, jitterRate=-0.04410526156425476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:18,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, ASSIGN in 464 msec 2023-02-16 09:00:18,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856., pid=22, masterSystemTime=1676538018584 2023-02-16 09:00:18,734 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1 2023-02-16 09:00:18,734 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1 2023-02-16 09:00:18,735 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e164cd29b3c4105974b1975e2a19a2 columnFamilyName f1 2023-02-16 09:00:18,736 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(310): Store=34e164cd29b3c4105974b1975e2a19a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,736 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:18,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fbf11cf41308153e75b27da2f592df30, NAME => 'testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 09:00:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,738 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6caeee774f45951fb67e0c0d4996b856, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018738"}]},"ts":"1676538018738"} 2023-02-16 09:00:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,740 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2 2023-02-16 09:00:18,743 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2 2023-02-16 09:00:18,743 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,743 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e164cd29b3c4105974b1975e2a19a2 columnFamilyName f2 2023-02-16 09:00:18,744 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(310): Store=34e164cd29b3c4105974b1975e2a19a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-16 09:00:18,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 6caeee774f45951fb67e0c0d4996b856, server=jenkins-hbase4.apache.org,44467,1676538014996 in 308 msec 2023-02-16 09:00:18,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,748 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1 2023-02-16 09:00:18,748 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1 2023-02-16 09:00:18,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,748 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf11cf41308153e75b27da2f592df30 columnFamilyName f1 2023-02-16 09:00:18,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, ASSIGN in 480 msec 2023-02-16 09:00:18,749 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(310): Store=fbf11cf41308153e75b27da2f592df30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,749 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,751 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2 2023-02-16 09:00:18,751 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2 2023-02-16 09:00:18,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,752 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf11cf41308153e75b27da2f592df30 columnFamilyName f2 2023-02-16 09:00:18,752 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(310): Store=fbf11cf41308153e75b27da2f592df30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:18,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34e164cd29b3c4105974b1975e2a19a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60926988, jitterRate=-0.09211713075637817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:18,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:18,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2., pid=27, masterSystemTime=1676538018598 2023-02-16 09:00:18,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fbf11cf41308153e75b27da2f592df30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72371665, jitterRate=0.07842184603214264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:18,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5b97478ff907745071a7a9f95dba17cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 09:00:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=34e164cd29b3c4105974b1975e2a19a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30., pid=24, masterSystemTime=1676538018584 2023-02-16 09:00:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018769"}]},"ts":"1676538018769"} 2023-02-16 09:00:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:18,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a55f046d5df1fae99a3320b025fd2b02, NAME => 'testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 09:00:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,773 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fbf11cf41308153e75b27da2f592df30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018773"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018773"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018773"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018773"}]},"ts":"1676538018773"} 2023-02-16 09:00:18,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-16 09:00:18,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 34e164cd29b3c4105974b1975e2a19a2, server=jenkins-hbase4.apache.org,43123,1676538014934 in 324 msec 2023-02-16 09:00:18,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, ASSIGN in 512 msec 2023-02-16 09:00:18,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-16 09:00:18,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure fbf11cf41308153e75b27da2f592df30, server=jenkins-hbase4.apache.org,44467,1676538014996 in 337 msec 2023-02-16 09:00:18,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, ASSIGN in 515 msec 2023-02-16 09:00:18,782 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,785 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1 2023-02-16 09:00:18,785 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1 2023-02-16 09:00:18,785 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a55f046d5df1fae99a3320b025fd2b02 columnFamilyName f1 2023-02-16 09:00:18,786 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(310): Store=a55f046d5df1fae99a3320b025fd2b02/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,786 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,788 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2 2023-02-16 09:00:18,788 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2 2023-02-16 09:00:18,788 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a55f046d5df1fae99a3320b025fd2b02 columnFamilyName f2 2023-02-16 09:00:18,789 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(310): Store=a55f046d5df1fae99a3320b025fd2b02/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,793 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,795 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1 2023-02-16 09:00:18,795 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1 2023-02-16 09:00:18,795 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b97478ff907745071a7a9f95dba17cc columnFamilyName f1 2023-02-16 09:00:18,796 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(310): Store=5b97478ff907745071a7a9f95dba17cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,796 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:18,799 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2 2023-02-16 09:00:18,800 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2 2023-02-16 09:00:18,800 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b97478ff907745071a7a9f95dba17cc columnFamilyName f2 2023-02-16 09:00:18,801 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(310): Store=5b97478ff907745071a7a9f95dba17cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a55f046d5df1fae99a3320b025fd2b02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67442224, jitterRate=0.004967451095581055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:18,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02., pid=26, masterSystemTime=1676538018584 2023-02-16 09:00:18,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:18,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a55f046d5df1fae99a3320b025fd2b02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:18,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018810"}]},"ts":"1676538018810"} 2023-02-16 09:00:18,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-16 09:00:18,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure a55f046d5df1fae99a3320b025fd2b02, server=jenkins-hbase4.apache.org,44467,1676538014996 in 368 msec 2023-02-16 09:00:18,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, ASSIGN in 552 msec 2023-02-16 09:00:18,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5b97478ff907745071a7a9f95dba17cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66831799, jitterRate=-0.004128590226173401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:18,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc., pid=25, masterSystemTime=1676538018598 2023-02-16 09:00:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:18,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e6c3b6d97d6db554bed480cdc72613c3, NAME => 'testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 09:00:18,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,823 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5b97478ff907745071a7a9f95dba17cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:18,823 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018823"}]},"ts":"1676538018823"} 2023-02-16 09:00:18,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,825 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,827 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1 2023-02-16 09:00:18,827 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1 2023-02-16 09:00:18,828 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c3b6d97d6db554bed480cdc72613c3 columnFamilyName f1 2023-02-16 09:00:18,828 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(310): Store=e6c3b6d97d6db554bed480cdc72613c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,829 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-16 09:00:18,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 5b97478ff907745071a7a9f95dba17cc, server=jenkins-hbase4.apache.org,43123,1676538014934 in 384 msec 2023-02-16 09:00:18,831 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2 2023-02-16 09:00:18,831 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2 2023-02-16 09:00:18,831 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c3b6d97d6db554bed480cdc72613c3 columnFamilyName f2 2023-02-16 09:00:18,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, ASSIGN in 565 msec 2023-02-16 09:00:18,832 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(310): Store=e6c3b6d97d6db554bed480cdc72613c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:18,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:18,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:18,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:18,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e6c3b6d97d6db554bed480cdc72613c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62486135, jitterRate=-0.06888402998447418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:18,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:18,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3., pid=29, masterSystemTime=1676538018598 2023-02-16 09:00:18,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:18,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e6c3b6d97d6db554bed480cdc72613c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:18,847 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538018846"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538018846"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538018846"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538018846"}]},"ts":"1676538018846"} 2023-02-16 09:00:18,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-16 09:00:18,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure e6c3b6d97d6db554bed480cdc72613c3, server=jenkins-hbase4.apache.org,43123,1676538014934 in 395 msec 2023-02-16 09:00:18,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-16 09:00:18,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, ASSIGN in 587 msec 2023-02-16 09:00:18,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:18,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538018856"}]},"ts":"1676538018856"} 2023-02-16 09:00:18,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 09:00:18,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:18,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 979 msec 2023-02-16 09:00:19,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:19,041 INFO [Listener at localhost/33963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 09:00:19,041 DEBUG [Listener at localhost/33963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 09:00:19,043 INFO [Listener at localhost/33963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:19,051 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 09:00:19,052 INFO [Listener at localhost/33963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:19,053 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 09:00:19,053 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:19,203 DEBUG [hconnection-0x28cc1dd8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:19,288 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54340, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:19,340 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43123] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:19,341 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44467] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:19,663 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:19,667 INFO [Listener at localhost/33963] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:19,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:19,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538019684 (current time:1676538019684). 2023-02-16 09:00:19,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:19,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] zookeeper.ReadOnlyZKClient(139): Connect 0x7e5606c5 to 127.0.0.1:57354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:19,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27823f01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:19,713 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:19,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e5606c5 to 127.0.0.1:57354 2023-02-16 09:00:19,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:19,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:19,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:19,747 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:19,749 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676538619748 2023-02-16 09:00:19,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:19,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 09:00:19,753 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:19,756 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:19,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:19,756 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:19,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 18 msec 2023-02-16 09:00:19,758 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:19,759 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676538619759 2023-02-16 09:00:19,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-16 09:00:19,811 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-16 09:00:19,811 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:19,811 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-16 09:00:19,811 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 09:00:19,812 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:19,812 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:19,814 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:19,814 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:19,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:19,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:19,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:19,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:19,814 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:19,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:19,815 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,815 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:19,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:19,816 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,816 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 09:00:19,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 09:00:19,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 09:00:19,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 09:00:19,821 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 09:00:19,821 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 09:00:19,822 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:19,821 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:19,822 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:19,823 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:19,823 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 09:00:19,823 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43123,1676538014934' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 09:00:19,823 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 09:00:19,823 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1676538014996' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 09:00:19,827 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,827 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:19,828 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,828 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,828 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:19,828 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43123,1676538014934' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155d05a5[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:19,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1676538014996' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 09:00:19,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155d05a5[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:19,834 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 09:00:19,834 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,836 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,836 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:19,837 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:19,837 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:19,838 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:19,839 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:19,839 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:19,840 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:19,840 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:19,841 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:19,841 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:19,840 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:19,840 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:19,841 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. started... 2023-02-16 09:00:19,841 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. started... 2023-02-16 09:00:19,842 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:19,842 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. started... 2023-02-16 09:00:19,842 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:19,842 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:19,842 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. started... 2023-02-16 09:00:19,842 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:19,842 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. started... 2023-02-16 09:00:19,844 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. started... 2023-02-16 09:00:19,845 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6caeee774f45951fb67e0c0d4996b856 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:19,846 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a55f046d5df1fae99a3320b025fd2b02 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:19,846 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5b97478ff907745071a7a9f95dba17cc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:19,847 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f5ac0259d99c40e14d3716eefafea69a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:19,847 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 34e164cd29b3c4105974b1975e2a19a2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:19,849 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:19,850 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:19,856 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:19,857 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:19,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:19,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:19,865 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:19,865 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:19,872 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:20,033 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. completed. 2023-02-16 09:00:20,034 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:20,036 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:20,036 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:20,036 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. started... 2023-02-16 09:00:20,041 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d9822b0b282723ef68c00cdc9a37a226 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:20,073 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:20,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:20,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:20,076 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 09:00:20,213 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f1/2f6ca7d9f74e4cbe82457a993f49a41c 2023-02-16 09:00:20,253 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f1/1cf67d2d10d443ec8815234fe27d317d 2023-02-16 09:00:20,253 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f1/c9b615d4c7444baab11a827bb1df35ab 2023-02-16 09:00:20,267 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f1/a03dd917dccc4e3eafb66381f9437897 2023-02-16 09:00:20,377 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:20,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:20,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:20,379 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 09:00:20,438 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f2/a0cb4fde0067497fbcf822dfcca6a16b 2023-02-16 09:00:20,439 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f2/a72c39ed449743c2b30f772d3a76337e 2023-02-16 09:00:20,452 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f1/2f6ca7d9f74e4cbe82457a993f49a41c as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c 2023-02-16 09:00:20,452 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f1/a03dd917dccc4e3eafb66381f9437897 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897 2023-02-16 09:00:20,464 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:20,465 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,468 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f2/a72c39ed449743c2b30f772d3a76337e as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e 2023-02-16 09:00:20,470 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f2/a0cb4fde0067497fbcf822dfcca6a16b as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b 2023-02-16 09:00:20,476 WARN [DataStreamer for file /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f2/00237f0e28de4932afaeab7a8ed99112] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-16 09:00:20,478 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f2/00237f0e28de4932afaeab7a8ed99112 2023-02-16 09:00:20,479 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f2/8f5c1c08540a4022ba10b8c94d923cf3 2023-02-16 09:00:20,489 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f1/c9b615d4c7444baab11a827bb1df35ab as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab 2023-02-16 09:00:20,489 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,491 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d9822b0b282723ef68c00cdc9a37a226 in 449ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,493 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 09:00:20,495 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:20,495 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,495 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,495 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897] hfiles 2023-02-16 09:00:20,496 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,498 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:20,498 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,500 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f2/00237f0e28de4932afaeab7a8ed99112 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112 2023-02-16 09:00:20,500 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b] hfiles 2023-02-16 09:00:20,500 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,504 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 34e164cd29b3c4105974b1975e2a19a2 in 658ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,505 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c] hfiles 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e] hfiles 2023-02-16 09:00:20,506 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,518 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f1/1cf67d2d10d443ec8815234fe27d317d as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d 2023-02-16 09:00:20,528 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,529 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f2/8f5c1c08540a4022ba10b8c94d923cf3 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3 2023-02-16 09:00:20,529 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,532 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6caeee774f45951fb67e0c0d4996b856 in 686ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab] hfiles 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112] hfiles 2023-02-16 09:00:20,533 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,538 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. completed. 2023-02-16 09:00:20,539 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:20,539 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:20,539 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:20,539 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. started... 2023-02-16 09:00:20,540 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,541 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2744): Flushing fbf11cf41308153e75b27da2f592df30 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:20,542 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a55f046d5df1fae99a3320b025fd2b02 in 697ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d] hfiles 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3] hfiles 2023-02-16 09:00:20,542 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,553 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. completed. 2023-02-16 09:00:20,553 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:20,553 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:20,554 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. completed. 2023-02-16 09:00:20,554 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:20,554 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:20,554 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:20,555 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. started... 2023-02-16 09:00:20,555 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:20,555 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,555 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,556 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:20,556 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:20,584 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f1/233f0e7e56c84864871dee75c4311829 2023-02-16 09:00:20,584 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. completed. 2023-02-16 09:00:20,584 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:20,604 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. completed. 2023-02-16 09:00:20,604 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:20,604 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:20,604 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:20,604 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. started... 2023-02-16 09:00:20,605 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e6c3b6d97d6db554bed480cdc72613c3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:20,629 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f1/e58f0165e8c94844a29b63f577555999 2023-02-16 09:00:20,630 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f2/887ccc33858c45ac8f34f87d8f8a6c6e 2023-02-16 09:00:20,638 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f1/233f0e7e56c84864871dee75c4311829 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829 2023-02-16 09:00:20,656 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:20,657 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f2/887ccc33858c45ac8f34f87d8f8a6c6e as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e 2023-02-16 09:00:20,664 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:20,665 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for fbf11cf41308153e75b27da2f592df30 in 125ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,665 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829] hfiles 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e] hfiles 2023-02-16 09:00:20,666 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,668 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 2023-02-16 09:00:20,679 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f1/18c028b1e180452abd3cc61cbf3d1e47 2023-02-16 09:00:20,736 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f2/478ed83ee1fb4c7ca8deaf12bc1d913e 2023-02-16 09:00:20,743 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f2/493172d5099447e0ab217516451b5d50 2023-02-16 09:00:20,746 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 2023-02-16 09:00:20,751 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f1/18c028b1e180452abd3cc61cbf3d1e47 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47 2023-02-16 09:00:20,754 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,756 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f2/478ed83ee1fb4c7ca8deaf12bc1d913e as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e 2023-02-16 09:00:20,770 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,772 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f2/493172d5099447e0ab217516451b5d50 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50 2023-02-16 09:00:20,781 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,781 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:20,782 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f5ac0259d99c40e14d3716eefafea69a in 935ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,782 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:20,782 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5b97478ff907745071a7a9f95dba17cc in 936ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:20,783 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,783 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:20,783 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600] hfiles 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e] hfiles 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,784 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:20,785 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47] hfiles 2023-02-16 09:00:20,785 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,785 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50] hfiles 2023-02-16 09:00:20,785 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:20,812 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. completed. 2023-02-16 09:00:20,812 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:20,812 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:20,814 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. completed. 2023-02-16 09:00:20,814 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:20,815 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:20,879 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:20,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:20,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:20,882 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 09:00:21,118 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f2/19309606ce1e40388def0aced0c38b18 2023-02-16 09:00:21,118 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. completed. 2023-02-16 09:00:21,118 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:21,118 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:21,118 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:21,118 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,118 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 09:00:21,118 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44467,1676538014996' in zk 2023-02-16 09:00:21,122 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:21,122 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,123 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:21,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,123 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 09:00:21,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:21,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:21,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:21,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:21,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:21,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44467,1676538014996': 2023-02-16 09:00:21,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1676538014996' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 09:00:21,131 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f1/e58f0165e8c94844a29b63f577555999 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999 2023-02-16 09:00:21,138 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:21,139 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f2/19309606ce1e40388def0aced0c38b18 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18 2023-02-16 09:00:21,147 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:21,152 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e6c3b6d97d6db554bed480cdc72613c3 in 547ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999] hfiles 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18] hfiles 2023-02-16 09:00:21,152 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18 for snapshot=testWithMapReduceMultiRegion 2023-02-16 09:00:21,163 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. completed. 2023-02-16 09:00:21,163 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 09:00:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43123,1676538014934' in zk 2023-02-16 09:00:21,167 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 09:00:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:21,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43123,1676538014934': 2023-02-16 09:00:21,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43123,1676538014934' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:21,177 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-16 09:00:21,177 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:21,177 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:21,177 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-16 09:00:21,177 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:21,180 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,180 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:21,180 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:21,180 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:21,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:21,182 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:21,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:21,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:21,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:21,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:21,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,183 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:21,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,186 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:21,187 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 09:00:21,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:21,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:21,203 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:21,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:21,204 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,204 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 09:00:21,204 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:21,205 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:21,205 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:21,205 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 09:00:21,205 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 09:00:21,203 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:21,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-16 09:00:21,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:21,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:21,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 09:00:21,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-16 09:00:21,331 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-16 09:00:21,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 09:00:21,331 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 09:00:21,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676538019752Consolidate snapshot: testWithMapReduceMultiRegion at 1676538021204 (+1452 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676538021205 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676538021252 (+47 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676538021274 (+22 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676538021331 (+57 ms) 2023-02-16 09:00:21,333 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:21,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5790 sec 2023-02-16 09:00:21,882 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:21,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:21,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:21,884 INFO [Listener at localhost/33963] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:21,898 INFO [Listener at localhost/33963] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:21,910 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:21,966 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44467] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:21,970 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43123] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:22,121 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:22,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:22,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 09:00:22,143 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 09:00:22,143 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:22,143 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 09:00:22,143 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 09:00:22,144 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,144 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,145 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:22,145 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:22,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:22,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:22,145 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,146 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,146 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,147 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,147 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:00:22,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:00:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:00:22,152 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:00:22,152 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:22,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:00:22,154 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:00:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:00:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. started... 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. started... 2023-02-16 09:00:22,156 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a55f046d5df1fae99a3320b025fd2b02 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,156 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f5ac0259d99c40e14d3716eefafea69a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:22,156 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. started... 2023-02-16 09:00:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:22,157 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5b97478ff907745071a7a9f95dba17cc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,157 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:22,157 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. started... 2023-02-16 09:00:22,157 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 34e164cd29b3c4105974b1975e2a19a2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:22,157 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:22,157 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. started... 2023-02-16 09:00:22,157 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:22,158 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:22,158 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:22,158 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:22,158 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:22,159 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:22,158 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:22,159 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. started... 2023-02-16 09:00:22,160 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. started... 2023-02-16 09:00:22,160 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d9822b0b282723ef68c00cdc9a37a226 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,160 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6caeee774f45951fb67e0c0d4996b856 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,239 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f1/b7a8305ab7714e179a122e03b397a4bb 2023-02-16 09:00:22,247 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f1/2090a0c7077f4f7aade870c3e0b4550c 2023-02-16 09:00:22,248 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f1/05650482a3214f8f9ea17f8c35d36e00 2023-02-16 09:00:22,250 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f1/6dcc5b86bf7d4778895eb47e00f90601 2023-02-16 09:00:22,252 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f1/d3cd5e994a944dcfa881f17d36b4f8d7 2023-02-16 09:00:22,270 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-16 09:00:22,289 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f2/0f7396667e1f418d9d09734a3c45d806 2023-02-16 09:00:22,305 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f1/b7a8305ab7714e179a122e03b397a4bb as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/b7a8305ab7714e179a122e03b397a4bb 2023-02-16 09:00:22,310 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f2/32134da07732440688a188900f886fd9 2023-02-16 09:00:22,320 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f2/567d83036ada468f9f66252e99b48008 2023-02-16 09:00:22,328 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f1/d3cd5e994a944dcfa881f17d36b4f8d7 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/d3cd5e994a944dcfa881f17d36b4f8d7 2023-02-16 09:00:22,329 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/b7a8305ab7714e179a122e03b397a4bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,330 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/.tmp/f2/0f7396667e1f418d9d09734a3c45d806 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/0f7396667e1f418d9d09734a3c45d806 2023-02-16 09:00:22,330 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f1/6dcc5b86bf7d4778895eb47e00f90601 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/6dcc5b86bf7d4778895eb47e00f90601 2023-02-16 09:00:22,336 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/d3cd5e994a944dcfa881f17d36b4f8d7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:22,338 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/.tmp/f2/32134da07732440688a188900f886fd9 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/32134da07732440688a188900f886fd9 2023-02-16 09:00:22,338 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/0f7396667e1f418d9d09734a3c45d806, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,339 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/6dcc5b86bf7d4778895eb47e00f90601, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,340 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6caeee774f45951fb67e0c0d4996b856 in 180ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,340 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:22,340 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:22,340 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:22,340 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. started... 2023-02-16 09:00:22,340 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:22,340 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fbf11cf41308153e75b27da2f592df30 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:22,342 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/.tmp/f2/567d83036ada468f9f66252e99b48008 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/567d83036ada468f9f66252e99b48008 2023-02-16 09:00:22,346 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/32134da07732440688a188900f886fd9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:22,348 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 34e164cd29b3c4105974b1975e2a19a2 in 190ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. started... 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:22,348 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:22,349 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. started... 2023-02-16 09:00:22,349 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e6c3b6d97d6db554bed480cdc72613c3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:22,363 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/567d83036ada468f9f66252e99b48008, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,364 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a55f046d5df1fae99a3320b025fd2b02 in 208ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,364 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:22,365 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:22,365 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:22,375 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f1/f54e7900574144c2b01ef027a31ff763 2023-02-16 09:00:22,379 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f1/a35fc1783f54410bb0b5651e836ee053 2023-02-16 09:00:22,392 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 09:00:22,393 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 09:00:22,403 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f2/0b00b0cfa190415aab6ca5ee46265b49 2023-02-16 09:00:22,408 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f2/f39151db4bab4b559957844677676d83 2023-02-16 09:00:22,411 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f1/f54e7900574144c2b01ef027a31ff763 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/f54e7900574144c2b01ef027a31ff763 2023-02-16 09:00:22,415 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f1/a35fc1783f54410bb0b5651e836ee053 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/a35fc1783f54410bb0b5651e836ee053 2023-02-16 09:00:22,417 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/f54e7900574144c2b01ef027a31ff763, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:22,418 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/.tmp/f2/0b00b0cfa190415aab6ca5ee46265b49 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/0b00b0cfa190415aab6ca5ee46265b49 2023-02-16 09:00:22,423 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/a35fc1783f54410bb0b5651e836ee053, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,424 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/.tmp/f2/f39151db4bab4b559957844677676d83 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/f39151db4bab4b559957844677676d83 2023-02-16 09:00:22,424 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/0b00b0cfa190415aab6ca5ee46265b49, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:22,425 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for fbf11cf41308153e75b27da2f592df30 in 85ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,425 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:22,426 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:22,426 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:22,430 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/f39151db4bab4b559957844677676d83, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,431 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e6c3b6d97d6db554bed480cdc72613c3 in 82ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,431 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:22,431 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:22,431 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:22,636 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f1/b661e13464674977989344ba616b2f14 2023-02-16 09:00:22,652 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f2/9ed57ce0eb8d4d938228d1201f4e5e7d 2023-02-16 09:00:22,659 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f1/b661e13464674977989344ba616b2f14 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/b661e13464674977989344ba616b2f14 2023-02-16 09:00:22,664 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/b661e13464674977989344ba616b2f14, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,665 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/.tmp/f2/9ed57ce0eb8d4d938228d1201f4e5e7d as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/9ed57ce0eb8d4d938228d1201f4e5e7d 2023-02-16 09:00:22,703 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/9ed57ce0eb8d4d938228d1201f4e5e7d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,704 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5b97478ff907745071a7a9f95dba17cc in 547ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,704 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:22,704 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:22,704 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:22,713 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f2/7ed0026f11b14a29baed80b6855b0da9 2023-02-16 09:00:22,716 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f2/57486d08b27747c498e6ffbd2106bc49 2023-02-16 09:00:22,720 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f1/2090a0c7077f4f7aade870c3e0b4550c as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/2090a0c7077f4f7aade870c3e0b4550c 2023-02-16 09:00:22,722 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f1/05650482a3214f8f9ea17f8c35d36e00 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/05650482a3214f8f9ea17f8c35d36e00 2023-02-16 09:00:22,726 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/2090a0c7077f4f7aade870c3e0b4550c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,727 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/.tmp/f2/7ed0026f11b14a29baed80b6855b0da9 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/7ed0026f11b14a29baed80b6855b0da9 2023-02-16 09:00:22,729 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/05650482a3214f8f9ea17f8c35d36e00, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,730 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/.tmp/f2/57486d08b27747c498e6ffbd2106bc49 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/57486d08b27747c498e6ffbd2106bc49 2023-02-16 09:00:22,732 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/7ed0026f11b14a29baed80b6855b0da9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,734 INFO [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d9822b0b282723ef68c00cdc9a37a226 in 573ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,734 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:22,734 DEBUG [rs(jenkins-hbase4.apache.org,44467,1676538014996)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:22,734 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:22,734 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:22,734 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,734 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:00:22,734 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1676538014996' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:00:22,737 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,737 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:22,738 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/57486d08b27747c498e6ffbd2106bc49, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,739 INFO [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f5ac0259d99c40e14d3716eefafea69a in 583ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:22,739 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:22,739 DEBUG [rs(jenkins-hbase4.apache.org,43123,1676538014934)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:22,739 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:22,739 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:22,739 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,739 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:00:22,739 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43123,1676538014934' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:00:22,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1676538014996' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 09:00:22,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4dd04f[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:22,741 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:22,741 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:22,742 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,742 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:22,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:22,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:22,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43123,1676538014934' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 09:00:22,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4dd04f[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:22,744 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 09:00:22,744 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:00:22,747 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43123,1676538014934' in zk 2023-02-16 09:00:22,747 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44467,1676538014996' in zk 2023-02-16 09:00:22,748 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,748 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:22,750 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,750 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:00:22,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:22,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:22,750 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:22,750 DEBUG [member: 'jenkins-hbase4.apache.org,43123,1676538014934' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:00:22,751 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,751 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:00:22,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:22,751 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:22,751 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1676538014996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:00:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43123,1676538014934': 2023-02-16 09:00:22,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43123,1676538014934' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 09:00:22,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:22,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:22,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:22,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44467,1676538014996': 2023-02-16 09:00:22,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1676538014996' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 09:00:22,758 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 09:00:22,758 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:22,758 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:22,758 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 09:00:22,758 INFO [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:22,760 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:22,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,760 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:22,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:22,761 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:22,762 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:22,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,764 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,764 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:22,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:22,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:22,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:22,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:22,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:22,770 DEBUG [(jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:22,770 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:22,771 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,771 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:22,771 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:22,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:22,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:22,773 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:22,773 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:22,771 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:22,873 DEBUG [Listener at localhost/33963] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:22,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:22,976 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop-8128907572693174538.jar 2023-02-16 09:00:22,994 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676538019684 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:22,996 DEBUG [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce 2023-02-16 09:00:22,996 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:22,997 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(239): region to add: fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=f5ac0259d99c40e14d3716eefafea69a as f5ac0259d99c40e14d3716eefafea69a in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=5b97478ff907745071a7a9f95dba17cc as 5b97478ff907745071a7a9f95dba17cc in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,998 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=a55f046d5df1fae99a3320b025fd2b02 as a55f046d5df1fae99a3320b025fd2b02 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=34e164cd29b3c4105974b1975e2a19a2 as 34e164cd29b3c4105974b1975e2a19a2 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=1781b02d9e51ff1c78ecaca8ce5a1581 as 1781b02d9e51ff1c78ecaca8ce5a1581 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=6caeee774f45951fb67e0c0d4996b856 as 6caeee774f45951fb67e0c0d4996b856 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=d1332b0816f9888e8fa4edc2b170d0df as d1332b0816f9888e8fa4edc2b170d0df in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=e6c3b6d97d6db554bed480cdc72613c3 as e6c3b6d97d6db554bed480cdc72613c3 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=d9822b0b282723ef68c00cdc9a37a226 as d9822b0b282723ef68c00cdc9a37a226 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:22,999 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(585): clone region=fbf11cf41308153e75b27da2f592df30 as fbf11cf41308153e75b27da2f592df30 in snapshot testWithMapReduceMultiRegion 2023-02-16 09:00:23,003 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5ac0259d99c40e14d3716eefafea69a, NAME => 'testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,004 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d1332b0816f9888e8fa4edc2b170d0df, NAME => 'testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,004 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a55f046d5df1fae99a3320b025fd2b02, NAME => 'testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,004 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5b97478ff907745071a7a9f95dba17cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,005 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => e6c3b6d97d6db554bed480cdc72613c3, NAME => 'testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,005 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 34e164cd29b3c4105974b1975e2a19a2, NAME => 'testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,005 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6caeee774f45951fb67e0c0d4996b856, NAME => 'testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,005 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1781b02d9e51ff1c78ecaca8ce5a1581, NAME => 'testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,036 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,037 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a2c3dd1c4a04d4c815e4fb6564a7600 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,048 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,048 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1cf67d2d10d443ec8815234fe27d317d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,053 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,053 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1781b02d9e51ff1c78ecaca8ce5a1581, disabling compactions & flushes 2023-02-16 09:00:23,053 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:23,053 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:23,053 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. after waiting 0 ms 2023-02-16 09:00:23,054 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:23,054 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:23,054 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:23,054 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d9822b0b282723ef68c00cdc9a37a226, NAME => 'testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,055 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 478ed83ee1fb4c7ca8deaf12bc1d913e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,057 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e58f0165e8c94844a29b63f577555999 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,057 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8f5c1c08540a4022ba10b8c94d923cf3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,058 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d1332b0816f9888e8fa4edc2b170d0df, disabling compactions & flushes 2023-02-16 09:00:23,058 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:23,058 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:23,058 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. after waiting 0 ms 2023-02-16 09:00:23,058 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:23,058 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:23,058 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:23,058 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => fbf11cf41308153e75b27da2f592df30, NAME => 'testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,064 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,065 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9b615d4c7444baab11a827bb1df35ab from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f5ac0259d99c40e14d3716eefafea69a, disabling compactions & flushes 2023-02-16 09:00:23,065 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:23,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:23,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. after waiting 0 ms 2023-02-16 09:00:23,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:23,065 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:23,066 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:23,066 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a55f046d5df1fae99a3320b025fd2b02, disabling compactions & flushes 2023-02-16 09:00:23,066 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:23,067 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:23,067 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. after waiting 0 ms 2023-02-16 09:00:23,067 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:23,067 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:23,067 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:23,067 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 00237f0e28de4932afaeab7a8ed99112 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,072 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6caeee774f45951fb67e0c0d4996b856, disabling compactions & flushes 2023-02-16 09:00:23,072 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:23,072 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:23,073 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. after waiting 0 ms 2023-02-16 09:00:23,073 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:23,073 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:23,073 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:23,077 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,078 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f6ca7d9f74e4cbe82457a993f49a41c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,084 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 19309606ce1e40388def0aced0c38b18 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,084 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,084 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 18c028b1e180452abd3cc61cbf3d1e47 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,084 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,084 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 233f0e7e56c84864871dee75c4311829 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,086 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a72c39ed449743c2b30f772d3a76337e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,092 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:23,092 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a03dd917dccc4e3eafb66381f9437897 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,093 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 34e164cd29b3c4105974b1975e2a19a2, disabling compactions & flushes 2023-02-16 09:00:23,093 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:23,093 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:23,093 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 887ccc33858c45ac8f34f87d8f8a6c6e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,093 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 493172d5099447e0ab217516451b5d50 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,093 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. after waiting 0 ms 2023-02-16 09:00:23,093 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing e6c3b6d97d6db554bed480cdc72613c3, disabling compactions & flushes 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:23,094 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:23,094 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. after waiting 0 ms 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:23,094 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:23,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:23,096 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0cb4fde0067497fbcf822dfcca6a16b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5b97478ff907745071a7a9f95dba17cc, disabling compactions & flushes 2023-02-16 09:00:23,097 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. after waiting 0 ms 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:23,097 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:23,097 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing fbf11cf41308153e75b27da2f592df30, disabling compactions & flushes 2023-02-16 09:00:23,097 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:23,098 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:23,098 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. after waiting 0 ms 2023-02-16 09:00:23,098 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:23,098 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:23,098 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:23,098 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d9822b0b282723ef68c00cdc9a37a226, disabling compactions & flushes 2023-02-16 09:00:23,099 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:23,099 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:23,099 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. after waiting 0 ms 2023-02-16 09:00:23,099 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:23,099 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:23,099 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:23,099 INFO [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676538019684 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:23,099 DEBUG [Listener at localhost/33963] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,099 DEBUG [Listener at localhost/33963] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe 2023-02-16 09:00:23,100 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:23,101 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:23,101 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 09:00:23,102 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------1781b02d9e51ff1c78ecaca8ce5a1581/ 2023-02-16 09:00:23,102 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,102 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------34e164cd29b3c4105974b1975e2a19a2/ 2023-02-16 09:00:23,103 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,103 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,103 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=34e164cd29b3c4105974b1975e2a19a2-2f6ca7d9f74e4cbe82457a993f49a41c 2023-02-16 09:00:23,104 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,104 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=34e164cd29b3c4105974b1975e2a19a2-a72c39ed449743c2b30f772d3a76337e 2023-02-16 09:00:23,104 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------5b97478ff907745071a7a9f95dba17cc/ 2023-02-16 09:00:23,105 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,105 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,105 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=5b97478ff907745071a7a9f95dba17cc-18c028b1e180452abd3cc61cbf3d1e47 2023-02-16 09:00:23,105 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,106 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=5b97478ff907745071a7a9f95dba17cc-493172d5099447e0ab217516451b5d50 2023-02-16 09:00:23,106 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------6caeee774f45951fb67e0c0d4996b856/ 2023-02-16 09:00:23,107 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,107 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,107 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=6caeee774f45951fb67e0c0d4996b856-c9b615d4c7444baab11a827bb1df35ab 2023-02-16 09:00:23,107 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,108 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=6caeee774f45951fb67e0c0d4996b856-00237f0e28de4932afaeab7a8ed99112 2023-02-16 09:00:23,108 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------a55f046d5df1fae99a3320b025fd2b02/ 2023-02-16 09:00:23,109 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,109 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,109 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=a55f046d5df1fae99a3320b025fd2b02-1cf67d2d10d443ec8815234fe27d317d 2023-02-16 09:00:23,109 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,110 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=a55f046d5df1fae99a3320b025fd2b02-8f5c1c08540a4022ba10b8c94d923cf3 2023-02-16 09:00:23,110 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------d1332b0816f9888e8fa4edc2b170d0df/ 2023-02-16 09:00:23,110 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,110 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------d9822b0b282723ef68c00cdc9a37a226/ 2023-02-16 09:00:23,111 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,111 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,111 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=d9822b0b282723ef68c00cdc9a37a226-a03dd917dccc4e3eafb66381f9437897 2023-02-16 09:00:23,111 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,112 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=d9822b0b282723ef68c00cdc9a37a226-a0cb4fde0067497fbcf822dfcca6a16b 2023-02-16 09:00:23,112 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------e6c3b6d97d6db554bed480cdc72613c3/ 2023-02-16 09:00:23,112 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,112 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,113 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=e6c3b6d97d6db554bed480cdc72613c3-e58f0165e8c94844a29b63f577555999 2023-02-16 09:00:23,113 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,113 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=e6c3b6d97d6db554bed480cdc72613c3-19309606ce1e40388def0aced0c38b18 2023-02-16 09:00:23,113 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------f5ac0259d99c40e14d3716eefafea69a/ 2023-02-16 09:00:23,114 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,114 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,114 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=f5ac0259d99c40e14d3716eefafea69a-2a2c3dd1c4a04d4c815e4fb6564a7600 2023-02-16 09:00:23,114 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,115 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=f5ac0259d99c40e14d3716eefafea69a-478ed83ee1fb4c7ca8deaf12bc1d913e 2023-02-16 09:00:23,115 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |----------fbf11cf41308153e75b27da2f592df30/ 2023-02-16 09:00:23,115 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:23,115 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:23,116 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=fbf11cf41308153e75b27da2f592df30-233f0e7e56c84864871dee75c4311829 2023-02-16 09:00:23,116 DEBUG [Listener at localhost/33963] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:23,116 DEBUG [Listener at localhost/33963] util.CommonFSUtils(702): |----------------testWithMapReduce=fbf11cf41308153e75b27da2f592df30-887ccc33858c45ac8f34f87d8f8a6c6e 2023-02-16 09:00:23,127 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:23,127 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:23,128 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:23,128 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:23,907 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:23,907 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 09:00:24,000 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop-612568502773025274.jar 2023-02-16 09:00:24,001 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,001 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,069 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop-4061999644969332970.jar 2023-02-16 09:00:24,069 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,070 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,070 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,071 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,071 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,072 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,072 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 09:00:24,072 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 09:00:24,073 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 09:00:24,073 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 09:00:24,074 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 09:00:24,074 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 09:00:24,075 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 09:00:24,075 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 09:00:24,075 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 09:00:24,076 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 09:00:24,082 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:24,082 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:24,083 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:24,083 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:24,084 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:00:24,152 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop-542736743418903682.jar 2023-02-16 09:00:24,153 DEBUG [Listener at localhost/33963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:00:24,201 WARN [Listener at localhost/33963] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 09:00:24,213 WARN [Listener at localhost/33963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 09:00:24,226 INFO [Listener at localhost/33963] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 09:00:24,607 WARN [Listener at localhost/33963] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/mapreduce.cluster.local.dir/1676538024509/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 09:00:24,607 WARN [Listener at localhost/33963] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/mapreduce.cluster.local.dir/1676538024509/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 09:00:24,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:24,797 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:24,800 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:24,802 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:24,803 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1 2023-02-16 09:00:24,804 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e164cd29b3c4105974b1975e2a19a2 columnFamilyName f1 2023-02-16 09:00:24,812 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/testWithMapReduce=34e164cd29b3c4105974b1975e2a19a2-2f6ca7d9f74e4cbe82457a993f49a41c 2023-02-16 09:00:24,813 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(310): Store=34e164cd29b3c4105974b1975e2a19a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:24,813 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:24,814 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2 2023-02-16 09:00:24,814 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e164cd29b3c4105974b1975e2a19a2 columnFamilyName f2 2023-02-16 09:00:24,820 DEBUG [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/testWithMapReduce=34e164cd29b3c4105974b1975e2a19a2-a72c39ed449743c2b30f772d3a76337e 2023-02-16 09:00:24,820 INFO [StoreOpener-34e164cd29b3c4105974b1975e2a19a2-1] regionserver.HStore(310): Store=34e164cd29b3c4105974b1975e2a19a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:24,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:24,821 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 34e164cd29b3c4105974b1975e2a19a2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70345575, jitterRate=0.04823075234889984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:24,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:25,003 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 34e164cd29b3c4105974b1975e2a19a2, disabling compactions & flushes 2023-02-16 09:00:25,003 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:25,003 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:25,003 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. after waiting 0 ms 2023-02-16 09:00:25,003 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:25,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:25,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:25,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,038 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,039 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,049 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:25,051 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f1 2023-02-16 09:00:25,052 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1781b02d9e51ff1c78ecaca8ce5a1581 columnFamilyName f1 2023-02-16 09:00:25,053 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(310): Store=1781b02d9e51ff1c78ecaca8ce5a1581/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,053 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:25,055 DEBUG [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f2 2023-02-16 09:00:25,056 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1781b02d9e51ff1c78ecaca8ce5a1581 columnFamilyName f2 2023-02-16 09:00:25,057 INFO [StoreOpener-1781b02d9e51ff1c78ecaca8ce5a1581-1] regionserver.HStore(310): Store=1781b02d9e51ff1c78ecaca8ce5a1581/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,058 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,058 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1781b02d9e51ff1c78ecaca8ce5a1581; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68119405, jitterRate=0.015058234333992004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,058 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:25,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1781b02d9e51ff1c78ecaca8ce5a1581, disabling compactions & flushes 2023-02-16 09:00:25,082 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:25,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:25,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. after waiting 0 ms 2023-02-16 09:00:25,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:25,084 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:25,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:25,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,090 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,093 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,095 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:25,096 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1 2023-02-16 09:00:25,096 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6caeee774f45951fb67e0c0d4996b856 columnFamilyName f1 2023-02-16 09:00:25,105 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/testWithMapReduce=6caeee774f45951fb67e0c0d4996b856-c9b615d4c7444baab11a827bb1df35ab 2023-02-16 09:00:25,105 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(310): Store=6caeee774f45951fb67e0c0d4996b856/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,105 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:25,106 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2 2023-02-16 09:00:25,107 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6caeee774f45951fb67e0c0d4996b856 columnFamilyName f2 2023-02-16 09:00:25,114 DEBUG [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/testWithMapReduce=6caeee774f45951fb67e0c0d4996b856-00237f0e28de4932afaeab7a8ed99112 2023-02-16 09:00:25,114 INFO [StoreOpener-6caeee774f45951fb67e0c0d4996b856-1] regionserver.HStore(310): Store=6caeee774f45951fb67e0c0d4996b856/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,115 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6caeee774f45951fb67e0c0d4996b856; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61394027, jitterRate=-0.08515770733356476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:25,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6caeee774f45951fb67e0c0d4996b856, disabling compactions & flushes 2023-02-16 09:00:25,182 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:25,183 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:25,183 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. after waiting 0 ms 2023-02-16 09:00:25,183 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:25,187 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:25,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:25,195 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,195 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,197 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,201 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:25,202 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1 2023-02-16 09:00:25,203 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b97478ff907745071a7a9f95dba17cc columnFamilyName f1 2023-02-16 09:00:25,210 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/testWithMapReduce=5b97478ff907745071a7a9f95dba17cc-18c028b1e180452abd3cc61cbf3d1e47 2023-02-16 09:00:25,211 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(310): Store=5b97478ff907745071a7a9f95dba17cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,211 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:25,212 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2 2023-02-16 09:00:25,212 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b97478ff907745071a7a9f95dba17cc columnFamilyName f2 2023-02-16 09:00:25,230 DEBUG [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/testWithMapReduce=5b97478ff907745071a7a9f95dba17cc-493172d5099447e0ab217516451b5d50 2023-02-16 09:00:25,230 INFO [StoreOpener-5b97478ff907745071a7a9f95dba17cc-1] regionserver.HStore(310): Store=5b97478ff907745071a7a9f95dba17cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,230 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,231 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5b97478ff907745071a7a9f95dba17cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60677052, jitterRate=-0.09584146738052368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:25,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5b97478ff907745071a7a9f95dba17cc, disabling compactions & flushes 2023-02-16 09:00:25,269 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:25,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:25,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. after waiting 0 ms 2023-02-16 09:00:25,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:25,273 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:25,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:25,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,281 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,282 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,289 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:25,290 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1 2023-02-16 09:00:25,291 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a55f046d5df1fae99a3320b025fd2b02 columnFamilyName f1 2023-02-16 09:00:25,306 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/testWithMapReduce=a55f046d5df1fae99a3320b025fd2b02-1cf67d2d10d443ec8815234fe27d317d 2023-02-16 09:00:25,307 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(310): Store=a55f046d5df1fae99a3320b025fd2b02/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,307 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:25,308 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2 2023-02-16 09:00:25,309 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a55f046d5df1fae99a3320b025fd2b02 columnFamilyName f2 2023-02-16 09:00:25,318 DEBUG [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/testWithMapReduce=a55f046d5df1fae99a3320b025fd2b02-8f5c1c08540a4022ba10b8c94d923cf3 2023-02-16 09:00:25,318 INFO [StoreOpener-a55f046d5df1fae99a3320b025fd2b02-1] regionserver.HStore(310): Store=a55f046d5df1fae99a3320b025fd2b02/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,318 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,319 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a55f046d5df1fae99a3320b025fd2b02; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73076469, jitterRate=0.08892424404621124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,319 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:25,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a55f046d5df1fae99a3320b025fd2b02, disabling compactions & flushes 2023-02-16 09:00:25,361 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:25,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:25,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. after waiting 0 ms 2023-02-16 09:00:25,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:25,365 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:25,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:25,370 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,370 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,383 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,386 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:25,388 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f1 2023-02-16 09:00:25,389 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1332b0816f9888e8fa4edc2b170d0df columnFamilyName f1 2023-02-16 09:00:25,390 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(310): Store=d1332b0816f9888e8fa4edc2b170d0df/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,390 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:25,392 DEBUG [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f2 2023-02-16 09:00:25,392 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1332b0816f9888e8fa4edc2b170d0df columnFamilyName f2 2023-02-16 09:00:25,393 INFO [StoreOpener-d1332b0816f9888e8fa4edc2b170d0df-1] regionserver.HStore(310): Store=d1332b0816f9888e8fa4edc2b170d0df/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,394 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d1332b0816f9888e8fa4edc2b170d0df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69506372, jitterRate=0.03572565317153931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:25,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d1332b0816f9888e8fa4edc2b170d0df, disabling compactions & flushes 2023-02-16 09:00:25,417 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:25,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:25,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. after waiting 0 ms 2023-02-16 09:00:25,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:25,421 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:25,421 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:25,425 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,426 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,428 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,430 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:25,432 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1 2023-02-16 09:00:25,432 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9822b0b282723ef68c00cdc9a37a226 columnFamilyName f1 2023-02-16 09:00:25,439 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/testWithMapReduce=d9822b0b282723ef68c00cdc9a37a226-a03dd917dccc4e3eafb66381f9437897 2023-02-16 09:00:25,439 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(310): Store=d9822b0b282723ef68c00cdc9a37a226/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,439 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:25,440 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2 2023-02-16 09:00:25,441 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9822b0b282723ef68c00cdc9a37a226 columnFamilyName f2 2023-02-16 09:00:25,460 DEBUG [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/testWithMapReduce=d9822b0b282723ef68c00cdc9a37a226-a0cb4fde0067497fbcf822dfcca6a16b 2023-02-16 09:00:25,461 INFO [StoreOpener-d9822b0b282723ef68c00cdc9a37a226-1] regionserver.HStore(310): Store=d9822b0b282723ef68c00cdc9a37a226/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,461 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d9822b0b282723ef68c00cdc9a37a226; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71852668, jitterRate=0.07068818807601929}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:25,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d9822b0b282723ef68c00cdc9a37a226, disabling compactions & flushes 2023-02-16 09:00:25,521 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:25,522 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:25,522 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. after waiting 0 ms 2023-02-16 09:00:25,522 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:25,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:25,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:25,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,532 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,536 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,538 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:25,539 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1 2023-02-16 09:00:25,539 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf11cf41308153e75b27da2f592df30 columnFamilyName f1 2023-02-16 09:00:25,545 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/testWithMapReduce=fbf11cf41308153e75b27da2f592df30-233f0e7e56c84864871dee75c4311829 2023-02-16 09:00:25,546 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(310): Store=fbf11cf41308153e75b27da2f592df30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,546 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:25,547 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2 2023-02-16 09:00:25,547 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf11cf41308153e75b27da2f592df30 columnFamilyName f2 2023-02-16 09:00:25,557 DEBUG [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/testWithMapReduce=fbf11cf41308153e75b27da2f592df30-887ccc33858c45ac8f34f87d8f8a6c6e 2023-02-16 09:00:25,558 INFO [StoreOpener-fbf11cf41308153e75b27da2f592df30-1] regionserver.HStore(310): Store=fbf11cf41308153e75b27da2f592df30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,558 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fbf11cf41308153e75b27da2f592df30; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64880055, jitterRate=-0.0332118421792984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:25,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fbf11cf41308153e75b27da2f592df30, disabling compactions & flushes 2023-02-16 09:00:25,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:25,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:25,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. after waiting 0 ms 2023-02-16 09:00:25,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:25,615 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:25,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:25,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,619 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,623 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,625 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:25,626 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1 2023-02-16 09:00:25,627 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ac0259d99c40e14d3716eefafea69a columnFamilyName f1 2023-02-16 09:00:25,636 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/testWithMapReduce=f5ac0259d99c40e14d3716eefafea69a-2a2c3dd1c4a04d4c815e4fb6564a7600 2023-02-16 09:00:25,636 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(310): Store=f5ac0259d99c40e14d3716eefafea69a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,636 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:25,637 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2 2023-02-16 09:00:25,637 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ac0259d99c40e14d3716eefafea69a columnFamilyName f2 2023-02-16 09:00:25,643 DEBUG [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/testWithMapReduce=f5ac0259d99c40e14d3716eefafea69a-478ed83ee1fb4c7ca8deaf12bc1d913e 2023-02-16 09:00:25,643 INFO [StoreOpener-f5ac0259d99c40e14d3716eefafea69a-1] regionserver.HStore(310): Store=f5ac0259d99c40e14d3716eefafea69a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,643 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f5ac0259d99c40e14d3716eefafea69a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68206699, jitterRate=0.01635901629924774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:25,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f5ac0259d99c40e14d3716eefafea69a, disabling compactions & flushes 2023-02-16 09:00:25,678 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:25,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:25,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. after waiting 0 ms 2023-02-16 09:00:25,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:25,681 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:25,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:25,685 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:25,685 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:25,689 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:25,691 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:25,692 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1 2023-02-16 09:00:25,693 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c3b6d97d6db554bed480cdc72613c3 columnFamilyName f1 2023-02-16 09:00:25,701 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/testWithMapReduce=e6c3b6d97d6db554bed480cdc72613c3-e58f0165e8c94844a29b63f577555999 2023-02-16 09:00:25,701 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(310): Store=e6c3b6d97d6db554bed480cdc72613c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,701 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:25,702 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2 2023-02-16 09:00:25,702 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c3b6d97d6db554bed480cdc72613c3 columnFamilyName f2 2023-02-16 09:00:25,707 DEBUG [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(539): loaded hdfs://localhost:43143/user/jenkins/test-data/a6200e84-a3ac-f68c-80cf-91a84bbb5067/testWithMapReduceMultiRegion/b9c7fdf5-3848-4730-8ab2-df1e7607e3fe/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/testWithMapReduce=e6c3b6d97d6db554bed480cdc72613c3-19309606ce1e40388def0aced0c38b18 2023-02-16 09:00:25,707 INFO [StoreOpener-e6c3b6d97d6db554bed480cdc72613c3-1] regionserver.HStore(310): Store=e6c3b6d97d6db554bed480cdc72613c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:25,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:25,708 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e6c3b6d97d6db554bed480cdc72613c3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72236430, jitterRate=0.07640668749809265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:25,708 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:25,736 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e6c3b6d97d6db554bed480cdc72613c3, disabling compactions & flushes 2023-02-16 09:00:25,736 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:25,736 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:25,736 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. after waiting 0 ms 2023-02-16 09:00:25,736 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:25,738 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:25,739 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:26,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-16 09:00:26,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-16 09:00:26,714 INFO [Listener at localhost/33963] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 09:00:26,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 09:00:26,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 09:00:26,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538026725"}]},"ts":"1676538026725"} 2023-02-16 09:00:26,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:26,728 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 09:00:26,733 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 09:00:26,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, UNASSIGN}] 2023-02-16 09:00:26,742 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, UNASSIGN 2023-02-16 09:00:26,742 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, UNASSIGN 2023-02-16 09:00:26,742 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, UNASSIGN 2023-02-16 09:00:26,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, UNASSIGN 2023-02-16 09:00:26,743 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, UNASSIGN 2023-02-16 09:00:26,743 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e6c3b6d97d6db554bed480cdc72613c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:26,743 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a55f046d5df1fae99a3320b025fd2b02, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:26,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026743"}]},"ts":"1676538026743"} 2023-02-16 09:00:26,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026743"}]},"ts":"1676538026743"} 2023-02-16 09:00:26,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6caeee774f45951fb67e0c0d4996b856, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:26,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026744"}]},"ts":"1676538026744"} 2023-02-16 09:00:26,744 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=34e164cd29b3c4105974b1975e2a19a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:26,745 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1781b02d9e51ff1c78ecaca8ce5a1581, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:26,745 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026744"}]},"ts":"1676538026744"} 2023-02-16 09:00:26,745 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538026745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026745"}]},"ts":"1676538026745"} 2023-02-16 09:00:26,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=40, state=RUNNABLE; CloseRegionProcedure e6c3b6d97d6db554bed480cdc72613c3, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:26,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure a55f046d5df1fae99a3320b025fd2b02, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:26,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 6caeee774f45951fb67e0c0d4996b856, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:26,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 34e164cd29b3c4105974b1975e2a19a2, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:26,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 1781b02d9e51ff1c78ecaca8ce5a1581, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:26,758 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, UNASSIGN 2023-02-16 09:00:26,759 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, UNASSIGN 2023-02-16 09:00:26,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5b97478ff907745071a7a9f95dba17cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:26,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026760"}]},"ts":"1676538026760"} 2023-02-16 09:00:26,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d9822b0b282723ef68c00cdc9a37a226, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:26,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026761"}]},"ts":"1676538026761"} 2023-02-16 09:00:26,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 5b97478ff907745071a7a9f95dba17cc, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:26,763 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, UNASSIGN 2023-02-16 09:00:26,763 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, UNASSIGN 2023-02-16 09:00:26,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure d9822b0b282723ef68c00cdc9a37a226, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:26,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f5ac0259d99c40e14d3716eefafea69a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:26,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026764"}]},"ts":"1676538026764"} 2023-02-16 09:00:26,765 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=fbf11cf41308153e75b27da2f592df30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:26,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026765"}]},"ts":"1676538026765"} 2023-02-16 09:00:26,768 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, UNASSIGN 2023-02-16 09:00:26,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure f5ac0259d99c40e14d3716eefafea69a, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:26,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure fbf11cf41308153e75b27da2f592df30, server=jenkins-hbase4.apache.org,44467,1676538014996}] 2023-02-16 09:00:26,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=d1332b0816f9888e8fa4edc2b170d0df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:26,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538026770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538026770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538026770"}]},"ts":"1676538026770"} 2023-02-16 09:00:26,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure d1332b0816f9888e8fa4edc2b170d0df, server=jenkins-hbase4.apache.org,43123,1676538014934}] 2023-02-16 09:00:26,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:26,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:26,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fbf11cf41308153e75b27da2f592df30, disabling compactions & flushes 2023-02-16 09:00:26,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:26,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:26,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. after waiting 0 ms 2023-02-16 09:00:26,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:26,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:26,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d1332b0816f9888e8fa4edc2b170d0df, disabling compactions & flushes 2023-02-16 09:00:26,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:26,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:26,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. after waiting 0 ms 2023-02-16 09:00:26,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:26,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:26,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df. 2023-02-16 09:00:26,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d1332b0816f9888e8fa4edc2b170d0df: 2023-02-16 09:00:26,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:26,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:26,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:26,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5b97478ff907745071a7a9f95dba17cc, disabling compactions & flushes 2023-02-16 09:00:26,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:26,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:26,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. after waiting 0 ms 2023-02-16 09:00:26,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:26,932 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=d1332b0816f9888e8fa4edc2b170d0df, regionState=CLOSED 2023-02-16 09:00:26,932 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538026932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026932"}]},"ts":"1676538026932"} 2023-02-16 09:00:26,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30. 2023-02-16 09:00:26,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fbf11cf41308153e75b27da2f592df30: 2023-02-16 09:00:26,938 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=fbf11cf41308153e75b27da2f592df30, regionState=CLOSED 2023-02-16 09:00:26,939 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026938"}]},"ts":"1676538026938"} 2023-02-16 09:00:26,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-16 09:00:26,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure d1332b0816f9888e8fa4edc2b170d0df, server=jenkins-hbase4.apache.org,43123,1676538014934 in 164 msec 2023-02-16 09:00:26,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d1332b0816f9888e8fa4edc2b170d0df, UNASSIGN in 203 msec 2023-02-16 09:00:26,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:26,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:26,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1781b02d9e51ff1c78ecaca8ce5a1581, disabling compactions & flushes 2023-02-16 09:00:26,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:26,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-16 09:00:26,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:26,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure fbf11cf41308153e75b27da2f592df30, server=jenkins-hbase4.apache.org,44467,1676538014996 in 172 msec 2023-02-16 09:00:26,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. after waiting 0 ms 2023-02-16 09:00:26,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:26,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:26,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc. 2023-02-16 09:00:26,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5b97478ff907745071a7a9f95dba17cc: 2023-02-16 09:00:26,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fbf11cf41308153e75b27da2f592df30, UNASSIGN in 208 msec 2023-02-16 09:00:26,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:26,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:26,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34e164cd29b3c4105974b1975e2a19a2, disabling compactions & flushes 2023-02-16 09:00:26,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:26,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:26,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. after waiting 0 ms 2023-02-16 09:00:26,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:26,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5b97478ff907745071a7a9f95dba17cc, regionState=CLOSED 2023-02-16 09:00:26,951 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026951"}]},"ts":"1676538026951"} 2023-02-16 09:00:26,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-16 09:00:26,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 5b97478ff907745071a7a9f95dba17cc, server=jenkins-hbase4.apache.org,43123,1676538014934 in 191 msec 2023-02-16 09:00:26,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:26,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5b97478ff907745071a7a9f95dba17cc, UNASSIGN in 219 msec 2023-02-16 09:00:26,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581. 2023-02-16 09:00:26,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1781b02d9e51ff1c78ecaca8ce5a1581: 2023-02-16 09:00:26,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:26,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:26,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a55f046d5df1fae99a3320b025fd2b02, disabling compactions & flushes 2023-02-16 09:00:26,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:26,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:26,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. after waiting 0 ms 2023-02-16 09:00:26,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:26,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1781b02d9e51ff1c78ecaca8ce5a1581, regionState=CLOSED 2023-02-16 09:00:26,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538026963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026963"}]},"ts":"1676538026963"} 2023-02-16 09:00:26,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-16 09:00:26,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 1781b02d9e51ff1c78ecaca8ce5a1581, server=jenkins-hbase4.apache.org,44467,1676538014996 in 209 msec 2023-02-16 09:00:26,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:26,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1781b02d9e51ff1c78ecaca8ce5a1581, UNASSIGN in 231 msec 2023-02-16 09:00:26,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2. 2023-02-16 09:00:26,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34e164cd29b3c4105974b1975e2a19a2: 2023-02-16 09:00:26,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:26,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:26,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f5ac0259d99c40e14d3716eefafea69a, disabling compactions & flushes 2023-02-16 09:00:26,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:26,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:26,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. after waiting 0 ms 2023-02-16 09:00:26,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:26,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=34e164cd29b3c4105974b1975e2a19a2, regionState=CLOSED 2023-02-16 09:00:26,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026976"}]},"ts":"1676538026976"} 2023-02-16 09:00:26,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-16 09:00:26,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 34e164cd29b3c4105974b1975e2a19a2, server=jenkins-hbase4.apache.org,43123,1676538014934 in 221 msec 2023-02-16 09:00:26,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34e164cd29b3c4105974b1975e2a19a2, UNASSIGN in 242 msec 2023-02-16 09:00:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:26,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02. 2023-02-16 09:00:26,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a55f046d5df1fae99a3320b025fd2b02: 2023-02-16 09:00:26,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:26,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:26,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6caeee774f45951fb67e0c0d4996b856, disabling compactions & flushes 2023-02-16 09:00:26,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:26,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:26,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. after waiting 0 ms 2023-02-16 09:00:26,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:26,993 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a55f046d5df1fae99a3320b025fd2b02, regionState=CLOSED 2023-02-16 09:00:26,994 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538026993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538026993"}]},"ts":"1676538026993"} 2023-02-16 09:00:27,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:27,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a. 2023-02-16 09:00:27,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f5ac0259d99c40e14d3716eefafea69a: 2023-02-16 09:00:27,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-16 09:00:27,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure a55f046d5df1fae99a3320b025fd2b02, server=jenkins-hbase4.apache.org,44467,1676538014996 in 243 msec 2023-02-16 09:00:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e6c3b6d97d6db554bed480cdc72613c3, disabling compactions & flushes 2023-02-16 09:00:27,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. after waiting 0 ms 2023-02-16 09:00:27,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:27,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f5ac0259d99c40e14d3716eefafea69a, regionState=CLOSED 2023-02-16 09:00:27,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538027005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538027005"}]},"ts":"1676538027005"} 2023-02-16 09:00:27,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a55f046d5df1fae99a3320b025fd2b02, UNASSIGN in 267 msec 2023-02-16 09:00:27,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-16 09:00:27,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure f5ac0259d99c40e14d3716eefafea69a, server=jenkins-hbase4.apache.org,43123,1676538014934 in 239 msec 2023-02-16 09:00:27,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5ac0259d99c40e14d3716eefafea69a, UNASSIGN in 273 msec 2023-02-16 09:00:27,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:27,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856. 2023-02-16 09:00:27,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6caeee774f45951fb67e0c0d4996b856: 2023-02-16 09:00:27,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:27,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:27,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d9822b0b282723ef68c00cdc9a37a226, disabling compactions & flushes 2023-02-16 09:00:27,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:27,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:27,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. after waiting 0 ms 2023-02-16 09:00:27,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:27,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6caeee774f45951fb67e0c0d4996b856, regionState=CLOSED 2023-02-16 09:00:27,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538027017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538027017"}]},"ts":"1676538027017"} 2023-02-16 09:00:27,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-16 09:00:27,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 6caeee774f45951fb67e0c0d4996b856, server=jenkins-hbase4.apache.org,44467,1676538014996 in 265 msec 2023-02-16 09:00:27,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6caeee774f45951fb67e0c0d4996b856, UNASSIGN in 285 msec 2023-02-16 09:00:27,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:27,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3. 2023-02-16 09:00:27,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e6c3b6d97d6db554bed480cdc72613c3: 2023-02-16 09:00:27,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:27,028 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e6c3b6d97d6db554bed480cdc72613c3, regionState=CLOSED 2023-02-16 09:00:27,028 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538027028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538027028"}]},"ts":"1676538027028"} 2023-02-16 09:00:27,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:27,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:27,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226. 2023-02-16 09:00:27,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d9822b0b282723ef68c00cdc9a37a226: 2023-02-16 09:00:27,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=40 2023-02-16 09:00:27,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=40, state=SUCCESS; CloseRegionProcedure e6c3b6d97d6db554bed480cdc72613c3, server=jenkins-hbase4.apache.org,43123,1676538014934 in 284 msec 2023-02-16 09:00:27,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:27,039 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d9822b0b282723ef68c00cdc9a37a226, regionState=CLOSED 2023-02-16 09:00:27,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538027039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538027039"}]},"ts":"1676538027039"} 2023-02-16 09:00:27,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6c3b6d97d6db554bed480cdc72613c3, UNASSIGN in 301 msec 2023-02-16 09:00:27,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-16 09:00:27,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure d9822b0b282723ef68c00cdc9a37a226, server=jenkins-hbase4.apache.org,44467,1676538014996 in 277 msec 2023-02-16 09:00:27,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-16 09:00:27,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d9822b0b282723ef68c00cdc9a37a226, UNASSIGN in 307 msec 2023-02-16 09:00:27,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538027046"}]},"ts":"1676538027046"} 2023-02-16 09:00:27,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 09:00:27,050 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 09:00:27,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 335 msec 2023-02-16 09:00:27,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:27,333 INFO [Listener at localhost/33963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-16 09:00:27,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 09:00:27,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,346 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,349 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:27,365 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:27,370 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/recovered.edits] 2023-02-16 09:00:27,371 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/recovered.edits] 2023-02-16 09:00:27,371 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/recovered.edits] 2023-02-16 09:00:27,371 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/recovered.edits] 2023-02-16 09:00:27,372 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/recovered.edits] 2023-02-16 09:00:27,373 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/recovered.edits] 2023-02-16 09:00:27,373 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/recovered.edits] 2023-02-16 09:00:27,373 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/recovered.edits] 2023-02-16 09:00:27,384 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/18c028b1e180452abd3cc61cbf3d1e47 2023-02-16 09:00:27,384 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/b7a8305ab7714e179a122e03b397a4bb to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/b7a8305ab7714e179a122e03b397a4bb 2023-02-16 09:00:27,384 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/233f0e7e56c84864871dee75c4311829 2023-02-16 09:00:27,385 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/1cf67d2d10d443ec8815234fe27d317d 2023-02-16 09:00:27,385 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/05650482a3214f8f9ea17f8c35d36e00 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/05650482a3214f8f9ea17f8c35d36e00 2023-02-16 09:00:27,385 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/2090a0c7077f4f7aade870c3e0b4550c to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/2090a0c7077f4f7aade870c3e0b4550c 2023-02-16 09:00:27,392 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/a35fc1783f54410bb0b5651e836ee053 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/a35fc1783f54410bb0b5651e836ee053 2023-02-16 09:00:27,393 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/6dcc5b86bf7d4778895eb47e00f90601 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f1/6dcc5b86bf7d4778895eb47e00f90601 2023-02-16 09:00:27,393 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/f54e7900574144c2b01ef027a31ff763 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f1/f54e7900574144c2b01ef027a31ff763 2023-02-16 09:00:27,393 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f1/2a2c3dd1c4a04d4c815e4fb6564a7600 2023-02-16 09:00:27,394 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f1/c9b615d4c7444baab11a827bb1df35ab 2023-02-16 09:00:27,394 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f1/a03dd917dccc4e3eafb66381f9437897 2023-02-16 09:00:27,394 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/recovered.edits/6.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df/recovered.edits/6.seqid 2023-02-16 09:00:27,395 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/b661e13464674977989344ba616b2f14 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f1/b661e13464674977989344ba616b2f14 2023-02-16 09:00:27,398 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d1332b0816f9888e8fa4edc2b170d0df 2023-02-16 09:00:27,398 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f1/e58f0165e8c94844a29b63f577555999 2023-02-16 09:00:27,398 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:27,404 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/recovered.edits] 2023-02-16 09:00:27,405 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/567d83036ada468f9f66252e99b48008 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/567d83036ada468f9f66252e99b48008 2023-02-16 09:00:27,405 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/00237f0e28de4932afaeab7a8ed99112 2023-02-16 09:00:27,406 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/7ed0026f11b14a29baed80b6855b0da9 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/7ed0026f11b14a29baed80b6855b0da9 2023-02-16 09:00:27,406 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/0b00b0cfa190415aab6ca5ee46265b49 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/0b00b0cfa190415aab6ca5ee46265b49 2023-02-16 09:00:27,406 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/478ed83ee1fb4c7ca8deaf12bc1d913e 2023-02-16 09:00:27,407 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/493172d5099447e0ab217516451b5d50 2023-02-16 09:00:27,407 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/19309606ce1e40388def0aced0c38b18 2023-02-16 09:00:27,409 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/f2/8f5c1c08540a4022ba10b8c94d923cf3 2023-02-16 09:00:27,410 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/0f7396667e1f418d9d09734a3c45d806 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/f2/0f7396667e1f418d9d09734a3c45d806 2023-02-16 09:00:27,410 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/f2/a0cb4fde0067497fbcf822dfcca6a16b 2023-02-16 09:00:27,410 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/9ed57ce0eb8d4d938228d1201f4e5e7d to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/f2/9ed57ce0eb8d4d938228d1201f4e5e7d 2023-02-16 09:00:27,410 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/f2/887ccc33858c45ac8f34f87d8f8a6c6e 2023-02-16 09:00:27,411 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/f39151db4bab4b559957844677676d83 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/f2/f39151db4bab4b559957844677676d83 2023-02-16 09:00:27,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/57486d08b27747c498e6ffbd2106bc49 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/f2/57486d08b27747c498e6ffbd2106bc49 2023-02-16 09:00:27,415 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/2f6ca7d9f74e4cbe82457a993f49a41c 2023-02-16 09:00:27,417 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02/recovered.edits/12.seqid 2023-02-16 09:00:27,418 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/a55f046d5df1fae99a3320b025fd2b02 2023-02-16 09:00:27,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:27,419 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc/recovered.edits/12.seqid 2023-02-16 09:00:27,419 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226/recovered.edits/12.seqid 2023-02-16 09:00:27,419 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/d3cd5e994a944dcfa881f17d36b4f8d7 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f1/d3cd5e994a944dcfa881f17d36b4f8d7 2023-02-16 09:00:27,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3/recovered.edits/12.seqid 2023-02-16 09:00:27,420 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856/recovered.edits/12.seqid 2023-02-16 09:00:27,421 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a/recovered.edits/12.seqid 2023-02-16 09:00:27,421 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/5b97478ff907745071a7a9f95dba17cc 2023-02-16 09:00:27,422 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/d9822b0b282723ef68c00cdc9a37a226 2023-02-16 09:00:27,422 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30/recovered.edits/12.seqid 2023-02-16 09:00:27,422 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/e6c3b6d97d6db554bed480cdc72613c3 2023-02-16 09:00:27,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/6caeee774f45951fb67e0c0d4996b856 2023-02-16 09:00:27,423 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/f5ac0259d99c40e14d3716eefafea69a 2023-02-16 09:00:27,423 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/fbf11cf41308153e75b27da2f592df30 2023-02-16 09:00:27,424 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f1, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/f2, FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/recovered.edits] 2023-02-16 09:00:27,427 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/32134da07732440688a188900f886fd9 to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/32134da07732440688a188900f886fd9 2023-02-16 09:00:27,429 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/f2/a72c39ed449743c2b30f772d3a76337e 2023-02-16 09:00:27,432 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/recovered.edits/6.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581/recovered.edits/6.seqid 2023-02-16 09:00:27,433 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/1781b02d9e51ff1c78ecaca8ce5a1581 2023-02-16 09:00:27,434 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/recovered.edits/12.seqid to hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/archive/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2/recovered.edits/12.seqid 2023-02-16 09:00:27,435 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/.tmp/data/default/testWithMapReduce/34e164cd29b3c4105974b1975e2a19a2 2023-02-16 09:00:27,435 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 09:00:27,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:27,470 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-16 09:00:27,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 09:00:27,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538027477"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,480 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 09:00:27,481 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1332b0816f9888e8fa4edc2b170d0df, NAME => 'testWithMapReduce,,1676538017878.d1332b0816f9888e8fa4edc2b170d0df.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => fbf11cf41308153e75b27da2f592df30, NAME => 'testWithMapReduce,aaa,1676538017878.fbf11cf41308153e75b27da2f592df30.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => f5ac0259d99c40e14d3716eefafea69a, NAME => 'testWithMapReduce,d\x84\x84,1676538017878.f5ac0259d99c40e14d3716eefafea69a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => d9822b0b282723ef68c00cdc9a37a226, NAME => 'testWithMapReduce,g\xA7\xA7,1676538017878.d9822b0b282723ef68c00cdc9a37a226.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 5b97478ff907745071a7a9f95dba17cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676538017878.5b97478ff907745071a7a9f95dba17cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 6caeee774f45951fb67e0c0d4996b856, NAME => 'testWithMapReduce,m\xED\xED,1676538017878.6caeee774f45951fb67e0c0d4996b856.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => e6c3b6d97d6db554bed480cdc72613c3, NAME => 'testWithMapReduce,q\x11\x10,1676538017878.e6c3b6d97d6db554bed480cdc72613c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => a55f046d5df1fae99a3320b025fd2b02, NAME => 'testWithMapReduce,t43,1676538017878.a55f046d5df1fae99a3320b025fd2b02.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 34e164cd29b3c4105974b1975e2a19a2, NAME => 'testWithMapReduce,wWV,1676538017878.34e164cd29b3c4105974b1975e2a19a2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 1781b02d9e51ff1c78ecaca8ce5a1581, NAME => 'testWithMapReduce,zz{,1676538017878.1781b02d9e51ff1c78ecaca8ce5a1581.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 09:00:27,481 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 09:00:27,481 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538027481"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:27,483 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 09:00:27,484 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:00:27,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 145 msec 2023-02-16 09:00:27,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:27,653 INFO [Listener at localhost/33963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-16 09:00:27,654 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:27,654 INFO [Listener at localhost/33963] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:27,654 DEBUG [Listener at localhost/33963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fa4f0e5 to 127.0.0.1:57354 2023-02-16 09:00:27,654 DEBUG [Listener at localhost/33963] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:27,654 DEBUG [Listener at localhost/33963] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:27,654 DEBUG [Listener at localhost/33963] util.JVMClusterUtil(257): Found active master hash=656351940, stopped=false 2023-02-16 09:00:27,655 INFO [Listener at localhost/33963] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:27,658 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:27,658 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:27,658 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:27,658 INFO [Listener at localhost/33963] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:27,658 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:27,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:27,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:27,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:27,660 DEBUG [Listener at localhost/33963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7815781e to 127.0.0.1:57354 2023-02-16 09:00:27,661 DEBUG [Listener at localhost/33963] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:27,661 INFO [Listener at localhost/33963] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43123,1676538014934' ***** 2023-02-16 09:00:27,661 INFO [Listener at localhost/33963] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:27,661 INFO [Listener at localhost/33963] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44467,1676538014996' ***** 2023-02-16 09:00:27,661 INFO [Listener at localhost/33963] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:27,662 INFO [RS:0;jenkins-hbase4:43123] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:27,662 INFO [RS:1;jenkins-hbase4:44467] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:27,662 INFO [RS:0;jenkins-hbase4:43123] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:27,662 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:27,662 INFO [RS:0;jenkins-hbase4:43123] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:27,662 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:27,662 INFO [RS:1;jenkins-hbase4:44467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:27,662 INFO [RS:1;jenkins-hbase4:44467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(3304): Received CLOSE for a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:27,663 DEBUG [RS:1;jenkins-hbase4:44467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dad7058 to 127.0.0.1:57354 2023-02-16 09:00:27,663 DEBUG [RS:1;jenkins-hbase4:44467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:27,663 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:27,662 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:27,662 DEBUG [RS:0;jenkins-hbase4:43123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03b1a199 to 127.0.0.1:57354 2023-02-16 09:00:27,664 DEBUG [RS:0;jenkins-hbase4:43123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:27,664 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43123,1676538014934; all regions closed. 2023-02-16 09:00:27,666 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 09:00:27,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a40b0ca3096d2168e61a22a6a76567f6, disabling compactions & flushes 2023-02-16 09:00:27,666 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1479): Online Regions={a40b0ca3096d2168e61a22a6a76567f6=hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 09:00:27,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:27,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:27,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. after waiting 0 ms 2023-02-16 09:00:27,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:27,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a40b0ca3096d2168e61a22a6a76567f6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:27,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:27,668 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1505): Waiting on 1588230740, a40b0ca3096d2168e61a22a6a76567f6 2023-02-16 09:00:27,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:27,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:27,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:27,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:27,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-16 09:00:27,691 DEBUG [RS:0;jenkins-hbase4:43123] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs 2023-02-16 09:00:27,691 INFO [RS:0;jenkins-hbase4:43123] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43123%2C1676538014934:(num 1676538017412) 2023-02-16 09:00:27,692 DEBUG [RS:0;jenkins-hbase4:43123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:27,692 INFO [RS:0;jenkins-hbase4:43123] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:27,696 INFO [RS:0;jenkins-hbase4:43123] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:27,696 INFO [RS:0;jenkins-hbase4:43123] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:27,696 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:27,696 INFO [RS:0;jenkins-hbase4:43123] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:27,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/.tmp/info/1ff1073dea8846e58ca4869b46d78b60 2023-02-16 09:00:27,697 INFO [RS:0;jenkins-hbase4:43123] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:27,698 INFO [RS:0;jenkins-hbase4:43123] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43123 2023-02-16 09:00:27,755 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:27,756 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:27,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/info/1f5064ac60fa4cc0b35d477537f4c705 2023-02-16 09:00:27,766 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:27,774 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:27,774 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43123,1676538014934 2023-02-16 09:00:27,774 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:27,774 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:27,774 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9800426 rejected from java.util.concurrent.ThreadPoolExecutor@dbf91ce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:27,775 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43123,1676538014934] 2023-02-16 09:00:27,775 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43123,1676538014934; numProcessing=1 2023-02-16 09:00:27,776 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43123,1676538014934 already deleted, retry=false 2023-02-16 09:00:27,777 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43123,1676538014934 expired; onlineServers=1 2023-02-16 09:00:27,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/.tmp/info/1ff1073dea8846e58ca4869b46d78b60 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/info/1ff1073dea8846e58ca4869b46d78b60 2023-02-16 09:00:27,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f5064ac60fa4cc0b35d477537f4c705 2023-02-16 09:00:27,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/info/1ff1073dea8846e58ca4869b46d78b60, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:27,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a40b0ca3096d2168e61a22a6a76567f6 in 137ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:27,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/rep_barrier/74a1b527ce2f4de3b955c43976c8eff1 2023-02-16 09:00:27,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/namespace/a40b0ca3096d2168e61a22a6a76567f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:27,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:27,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a40b0ca3096d2168e61a22a6a76567f6: 2023-02-16 09:00:27,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538016955.a40b0ca3096d2168e61a22a6a76567f6. 2023-02-16 09:00:27,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74a1b527ce2f4de3b955c43976c8eff1 2023-02-16 09:00:27,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/table/eb245c94dda7457a9feb2076cfd8e0e0 2023-02-16 09:00:27,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb245c94dda7457a9feb2076cfd8e0e0 2023-02-16 09:00:27,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/info/1f5064ac60fa4cc0b35d477537f4c705 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/info/1f5064ac60fa4cc0b35d477537f4c705 2023-02-16 09:00:27,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f5064ac60fa4cc0b35d477537f4c705 2023-02-16 09:00:27,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/info/1f5064ac60fa4cc0b35d477537f4c705, entries=30, sequenceid=57, filesize=7.9 K 2023-02-16 09:00:27,867 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/rep_barrier/74a1b527ce2f4de3b955c43976c8eff1 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/rep_barrier/74a1b527ce2f4de3b955c43976c8eff1 2023-02-16 09:00:27,869 DEBUG [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 09:00:27,873 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74a1b527ce2f4de3b955c43976c8eff1 2023-02-16 09:00:27,873 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/rep_barrier/74a1b527ce2f4de3b955c43976c8eff1, entries=10, sequenceid=57, filesize=5.9 K 2023-02-16 09:00:27,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/.tmp/table/eb245c94dda7457a9feb2076cfd8e0e0 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/table/eb245c94dda7457a9feb2076cfd8e0e0 2023-02-16 09:00:27,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb245c94dda7457a9feb2076cfd8e0e0 2023-02-16 09:00:27,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/table/eb245c94dda7457a9feb2076cfd8e0e0, entries=13, sequenceid=57, filesize=5.9 K 2023-02-16 09:00:27,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 220ms, sequenceid=57, compaction requested=false 2023-02-16 09:00:27,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 09:00:27,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:27,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:27,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:27,905 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:28,069 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44467,1676538014996; all regions closed. 2023-02-16 09:00:28,077 DEBUG [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs 2023-02-16 09:00:28,077 INFO [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44467%2C1676538014996.meta:.meta(num 1676538016689) 2023-02-16 09:00:28,083 DEBUG [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/oldWALs 2023-02-16 09:00:28,083 INFO [RS:1;jenkins-hbase4:44467] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44467%2C1676538014996:(num 1676538017413) 2023-02-16 09:00:28,083 DEBUG [RS:1;jenkins-hbase4:44467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:28,083 INFO [RS:1;jenkins-hbase4:44467] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:28,083 INFO [RS:1;jenkins-hbase4:44467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:28,084 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:28,085 INFO [RS:1;jenkins-hbase4:44467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44467 2023-02-16 09:00:28,089 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:28,089 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44467,1676538014996 2023-02-16 09:00:28,089 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f6a55b3 rejected from java.util.concurrent.ThreadPoolExecutor@3b55c686[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,090 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44467,1676538014996] 2023-02-16 09:00:28,090 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44467,1676538014996; numProcessing=2 2023-02-16 09:00:28,091 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44467,1676538014996 already deleted, retry=false 2023-02-16 09:00:28,091 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44467,1676538014996 expired; onlineServers=0 2023-02-16 09:00:28,091 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40701,1676538013734' ***** 2023-02-16 09:00:28,091 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:28,092 DEBUG [M:0;jenkins-hbase4:40701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@662228ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:28,092 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40701,1676538013734 2023-02-16 09:00:28,092 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40701,1676538013734; all regions closed. 2023-02-16 09:00:28,092 DEBUG [M:0;jenkins-hbase4:40701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:28,092 DEBUG [M:0;jenkins-hbase4:40701] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:28,092 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:28,092 DEBUG [M:0;jenkins-hbase4:40701] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:28,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538016155] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538016155,5,FailOnTimeoutGroup] 2023-02-16 09:00:28,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538016156] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538016156,5,FailOnTimeoutGroup] 2023-02-16 09:00:28,094 INFO [M:0;jenkins-hbase4:40701] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:28,095 INFO [M:0;jenkins-hbase4:40701] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:28,095 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:28,095 INFO [M:0;jenkins-hbase4:40701] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:28,095 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:28,095 DEBUG [M:0;jenkins-hbase4:40701] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:28,096 INFO [M:0;jenkins-hbase4:40701] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:28,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:28,096 ERROR [M:0;jenkins-hbase4:40701] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-16 09:00:28,097 INFO [M:0;jenkins-hbase4:40701] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:28,097 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:28,097 DEBUG [M:0;jenkins-hbase4:40701] zookeeper.ZKUtil(398): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:28,098 WARN [M:0;jenkins-hbase4:40701] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:28,098 INFO [M:0;jenkins-hbase4:40701] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:28,098 INFO [M:0;jenkins-hbase4:40701] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:28,099 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:28,099 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:28,099 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:28,099 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:28,099 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:28,099 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.14 KB 2023-02-16 09:00:28,119 INFO [M:0;jenkins-hbase4:40701] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f155613837644c52832693e4472d0219 2023-02-16 09:00:28,126 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f155613837644c52832693e4472d0219 as hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f155613837644c52832693e4472d0219 2023-02-16 09:00:28,131 INFO [M:0;jenkins-hbase4:40701] regionserver.HStore(1080): Added hdfs://localhost:43143/user/jenkins/test-data/0b9e321d-b42e-cab8-4936-b3bedd376bc5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f155613837644c52832693e4472d0219, entries=53, sequenceid=357, filesize=10.4 K 2023-02-16 09:00:28,133 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163056, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false 2023-02-16 09:00:28,134 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:28,134 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:28,148 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:28,148 INFO [M:0;jenkins-hbase4:40701] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:28,148 INFO [M:0;jenkins-hbase4:40701] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40701 2023-02-16 09:00:28,152 DEBUG [M:0;jenkins-hbase4:40701] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40701,1676538013734 already deleted, retry=false 2023-02-16 09:00:28,160 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,160 INFO [RS:0;jenkins-hbase4:43123] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43123,1676538014934; zookeeper connection closed. 2023-02-16 09:00:28,160 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70178fbe rejected from java.util.concurrent.ThreadPoolExecutor@dbf91ce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,160 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:43123-0x1005c5bce620001, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,160 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2150dd8b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2150dd8b 2023-02-16 09:00:28,160 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@87fdba6 rejected from java.util.concurrent.ThreadPoolExecutor@dbf91ce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,260 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,260 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40701,1676538013734; zookeeper connection closed. 2023-02-16 09:00:28,260 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c63219e rejected from java.util.concurrent.ThreadPoolExecutor@431c168b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,261 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): master:40701-0x1005c5bce620000, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,261 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e39fed6 rejected from java.util.concurrent.ThreadPoolExecutor@431c168b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,360 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,361 INFO [RS:1;jenkins-hbase4:44467] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44467,1676538014996; zookeeper connection closed. 2023-02-16 09:00:28,361 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22c99fa9 rejected from java.util.concurrent.ThreadPoolExecutor@3b55c686[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,361 DEBUG [Listener at localhost/33963-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x1005c5bce620002, quorum=127.0.0.1:57354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:28,361 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@62187e1c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@62187e1c 2023-02-16 09:00:28,361 ERROR [Listener at localhost/33963-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a971f02 rejected from java.util.concurrent.ThreadPoolExecutor@3b55c686[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:28,362 INFO [Listener at localhost/33963] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:28,362 WARN [Listener at localhost/33963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:28,366 INFO [Listener at localhost/33963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:28,471 WARN [BP-342975109-172.31.14.131-1676538010101 heartbeating to localhost/127.0.0.1:43143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:28,471 WARN [BP-342975109-172.31.14.131-1676538010101 heartbeating to localhost/127.0.0.1:43143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-342975109-172.31.14.131-1676538010101 (Datanode Uuid 8beb116f-7e45-43f9-80b1-4b83d43c9a0e) service to localhost/127.0.0.1:43143 2023-02-16 09:00:28,473 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/dfs/data/data3/current/BP-342975109-172.31.14.131-1676538010101] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:28,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/dfs/data/data4/current/BP-342975109-172.31.14.131-1676538010101] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:28,476 WARN [Listener at localhost/33963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:28,478 INFO [Listener at localhost/33963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:28,584 WARN [BP-342975109-172.31.14.131-1676538010101 heartbeating to localhost/127.0.0.1:43143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:28,585 WARN [BP-342975109-172.31.14.131-1676538010101 heartbeating to localhost/127.0.0.1:43143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-342975109-172.31.14.131-1676538010101 (Datanode Uuid c3f502bf-109e-41fd-b69d-86f9d9f50211) service to localhost/127.0.0.1:43143 2023-02-16 09:00:28,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/dfs/data/data1/current/BP-342975109-172.31.14.131-1676538010101] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:28,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/cluster_c5d13640-1851-c15a-61b2-d93381feb7b1/dfs/data/data2/current/BP-342975109-172.31.14.131-1676538010101] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:28,626 INFO [Listener at localhost/33963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:28,749 INFO [Listener at localhost/33963] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:00:28,845 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:00:28,861 INFO [Listener at localhost/33963] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43143 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33963 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:43143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@3903c51 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43143 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40701,1676538013734)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:43143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=532 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 141) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2285 (was 3697) 2023-02-16 09:00:28,874 INFO [Listener at localhost/33963] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=532, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=169, AvailableMemoryMB=2285 2023-02-16 09:00:28,886 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.log.dir so I do NOT create it in target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808 2023-02-16 09:00:28,886 WARN [Listener at localhost/33963] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:00:28,886 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.tmp.dir so I do NOT create it in target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808 2023-02-16 09:00:28,886 WARN [Listener at localhost/33963] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f0ff059-38da-9452-f9e2-b5e3894c65d5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:00:28,886 DEBUG [Listener at localhost/33963] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808 2023-02-16 09:00:28,887 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:28,887 INFO [Listener at localhost/33963] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e, deleteOnExit=true 2023-02-16 09:00:28,888 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:28,888 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/test.cache.data in system properties and HBase conf 2023-02-16 09:00:28,888 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:28,888 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:28,889 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:28,889 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:28,889 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:28,889 DEBUG [Listener at localhost/33963] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:28,889 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:28,890 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:28,891 INFO [Listener at localhost/33963] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:28,896 WARN [Listener at localhost/33963] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:28,896 WARN [Listener at localhost/33963] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:28,952 WARN [Listener at localhost/33963] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:28,955 INFO [Listener at localhost/33963] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:28,961 INFO [Listener at localhost/33963] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/java.io.tmpdir/Jetty_localhost_33397_hdfs____caataz/webapp 2023-02-16 09:00:29,076 INFO [Listener at localhost/33963] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33397 2023-02-16 09:00:29,081 WARN [Listener at localhost/33963] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:29,081 WARN [Listener at localhost/33963] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:29,123 WARN [Listener at localhost/35125] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:29,144 WARN [Listener at localhost/35125] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:29,147 WARN [Listener at localhost/35125] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:29,148 INFO [Listener at localhost/35125] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:29,154 INFO [Listener at localhost/35125] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/java.io.tmpdir/Jetty_localhost_36861_datanode____di8as7/webapp 2023-02-16 09:00:29,249 INFO [Listener at localhost/35125] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36861 2023-02-16 09:00:29,260 WARN [Listener at localhost/41417] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:29,276 WARN [Listener at localhost/41417] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:29,278 WARN [Listener at localhost/41417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:29,280 INFO [Listener at localhost/41417] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:29,284 INFO [Listener at localhost/41417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/java.io.tmpdir/Jetty_localhost_46105_datanode____y6iql7/webapp 2023-02-16 09:00:29,376 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb1907079981047d: Processing first storage report for DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e from datanode 9136d036-9f88-46ac-afa5-4eb5c23adc76 2023-02-16 09:00:29,377 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb1907079981047d: from storage DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e node DatanodeRegistration(127.0.0.1:37447, datanodeUuid=9136d036-9f88-46ac-afa5-4eb5c23adc76, infoPort=42195, infoSecurePort=0, ipcPort=41417, storageInfo=lv=-57;cid=testClusterID;nsid=851519670;c=1676538028899), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:29,377 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb1907079981047d: Processing first storage report for DS-e713a68b-b859-473e-b0ad-c28192cb8bfe from datanode 9136d036-9f88-46ac-afa5-4eb5c23adc76 2023-02-16 09:00:29,377 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb1907079981047d: from storage DS-e713a68b-b859-473e-b0ad-c28192cb8bfe node DatanodeRegistration(127.0.0.1:37447, datanodeUuid=9136d036-9f88-46ac-afa5-4eb5c23adc76, infoPort=42195, infoSecurePort=0, ipcPort=41417, storageInfo=lv=-57;cid=testClusterID;nsid=851519670;c=1676538028899), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:29,404 INFO [Listener at localhost/41417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46105 2023-02-16 09:00:29,414 WARN [Listener at localhost/33217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:29,517 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10c5aed872cae528: Processing first storage report for DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7 from datanode 079d6161-0ed5-4276-ab9b-a69a95f96b22 2023-02-16 09:00:29,517 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10c5aed872cae528: from storage DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7 node DatanodeRegistration(127.0.0.1:45111, datanodeUuid=079d6161-0ed5-4276-ab9b-a69a95f96b22, infoPort=41561, infoSecurePort=0, ipcPort=33217, storageInfo=lv=-57;cid=testClusterID;nsid=851519670;c=1676538028899), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:29,517 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10c5aed872cae528: Processing first storage report for DS-69d7bf2a-b2e3-469e-aff4-eb20f6564a63 from datanode 079d6161-0ed5-4276-ab9b-a69a95f96b22 2023-02-16 09:00:29,517 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10c5aed872cae528: from storage DS-69d7bf2a-b2e3-469e-aff4-eb20f6564a63 node DatanodeRegistration(127.0.0.1:45111, datanodeUuid=079d6161-0ed5-4276-ab9b-a69a95f96b22, infoPort=41561, infoSecurePort=0, ipcPort=33217, storageInfo=lv=-57;cid=testClusterID;nsid=851519670;c=1676538028899), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:29,522 DEBUG [Listener at localhost/33217] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808 2023-02-16 09:00:29,525 INFO [Listener at localhost/33217] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/zookeeper_0, clientPort=64894, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:29,527 INFO [Listener at localhost/33217] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64894 2023-02-16 09:00:29,528 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,529 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,549 INFO [Listener at localhost/33217] util.FSUtils(479): Created version file at hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b with version=8 2023-02-16 09:00:29,550 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,551 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,553 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/hbase-staging 2023-02-16 09:00:29,555 INFO [Listener at localhost/33217] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:29,555 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,555 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,556 INFO [Listener at localhost/33217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:29,556 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,556 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:29,556 INFO [Listener at localhost/33217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:29,562 INFO [Listener at localhost/33217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45373 2023-02-16 09:00:29,563 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,564 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,566 INFO [Listener at localhost/33217] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45373 connecting to ZooKeeper ensemble=127.0.0.1:64894 2023-02-16 09:00:29,578 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:453730x0, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:29,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45373-0x1005c5c0f9a0000 connected 2023-02-16 09:00:29,603 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:29,604 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:29,604 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:29,605 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45373 2023-02-16 09:00:29,605 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45373 2023-02-16 09:00:29,608 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45373 2023-02-16 09:00:29,611 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45373 2023-02-16 09:00:29,612 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45373 2023-02-16 09:00:29,612 INFO [Listener at localhost/33217] master.HMaster(444): hbase.rootdir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b, hbase.cluster.distributed=false 2023-02-16 09:00:29,632 INFO [Listener at localhost/33217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:29,632 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,632 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,633 INFO [Listener at localhost/33217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:29,633 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,633 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:29,633 INFO [Listener at localhost/33217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:29,635 INFO [Listener at localhost/33217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41677 2023-02-16 09:00:29,635 INFO [Listener at localhost/33217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:29,639 DEBUG [Listener at localhost/33217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:29,640 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,641 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,642 INFO [Listener at localhost/33217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41677 connecting to ZooKeeper ensemble=127.0.0.1:64894 2023-02-16 09:00:29,645 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:416770x0, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:29,646 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:416770x0, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:29,646 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:416770x0, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:29,647 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:416770x0, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:29,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41677-0x1005c5c0f9a0001 connected 2023-02-16 09:00:29,654 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-16 09:00:29,654 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41677 2023-02-16 09:00:29,656 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41677 2023-02-16 09:00:29,656 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-16 09:00:29,659 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41677 2023-02-16 09:00:29,672 INFO [Listener at localhost/33217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:29,672 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,673 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,673 INFO [Listener at localhost/33217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:29,673 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:29,673 INFO [Listener at localhost/33217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:29,673 INFO [Listener at localhost/33217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:29,675 INFO [Listener at localhost/33217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45341 2023-02-16 09:00:29,675 INFO [Listener at localhost/33217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:29,684 DEBUG [Listener at localhost/33217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:29,684 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,685 INFO [Listener at localhost/33217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,686 INFO [Listener at localhost/33217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45341 connecting to ZooKeeper ensemble=127.0.0.1:64894 2023-02-16 09:00:29,689 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:453410x0, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:29,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45341-0x1005c5c0f9a0002 connected 2023-02-16 09:00:29,690 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:29,690 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:29,691 DEBUG [Listener at localhost/33217] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:29,692 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45341 2023-02-16 09:00:29,692 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45341 2023-02-16 09:00:29,696 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45341 2023-02-16 09:00:29,696 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45341 2023-02-16 09:00:29,696 DEBUG [Listener at localhost/33217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45341 2023-02-16 09:00:29,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,698 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:29,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,701 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:29,701 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:29,701 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:29,702 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:29,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45373,1676538029555 from backup master directory 2023-02-16 09:00:29,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:29,705 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,705 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:29,705 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:29,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/hbase.id with ID: 086965cc-bbf5-4f8d-a932-7079e22042dc 2023-02-16 09:00:29,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:29,732 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7747b684 to 127.0.0.1:64894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:29,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25a0362f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:29,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:29,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:29,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:29,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store-tmp 2023-02-16 09:00:29,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:29,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:29,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:29,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:29,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:29,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:29,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:29,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:29,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/WALs/jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45373%2C1676538029555, suffix=, logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/WALs/jenkins-hbase4.apache.org,45373,1676538029555, archiveDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:29,774 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK] 2023-02-16 09:00:29,776 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK] 2023-02-16 09:00:29,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/WALs/jenkins-hbase4.apache.org,45373,1676538029555/jenkins-hbase4.apache.org%2C45373%2C1676538029555.1676538029759 2023-02-16 09:00:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK], DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK]] 2023-02-16 09:00:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,783 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,784 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:29,785 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:29,785 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:29,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:29,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:29,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61370338, jitterRate=-0.08551070094108582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:29,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:29,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:29,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:29,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:29,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:29,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:00:29,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:00:29,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:29,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:29,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:29,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:29,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:29,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:29,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:29,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:29,813 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:29,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:29,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:29,815 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:29,815 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:29,815 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:29,815 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45373,1676538029555, sessionid=0x1005c5c0f9a0000, setting cluster-up flag (Was=false) 2023-02-16 09:00:29,820 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:29,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,829 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:29,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:29,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:29,834 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/.tmp 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538059840 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:29,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,844 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:29,844 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:29,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538029845,5,FailOnTimeoutGroup] 2023-02-16 09:00:29,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538029845,5,FailOnTimeoutGroup] 2023-02-16 09:00:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,846 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:29,862 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:29,863 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:29,863 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b 2023-02-16 09:00:29,873 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:29,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:29,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/info 2023-02-16 09:00:29,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:29,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:29,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:29,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:29,878 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:29,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:29,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:29,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/table 2023-02-16 09:00:29,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:29,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:29,881 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740 2023-02-16 09:00:29,881 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740 2023-02-16 09:00:29,883 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:29,884 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:29,885 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:29,886 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63940448, jitterRate=-0.047213077545166016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:29,886 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:29,886 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:29,886 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:29,886 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:29,886 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:29,886 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:29,887 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:29,887 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:29,888 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:29,888 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:29,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:29,890 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:29,891 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:29,899 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(952): ClusterId : 086965cc-bbf5-4f8d-a932-7079e22042dc 2023-02-16 09:00:29,899 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(952): ClusterId : 086965cc-bbf5-4f8d-a932-7079e22042dc 2023-02-16 09:00:29,899 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:29,899 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:29,903 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:29,903 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:29,903 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:29,903 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:29,905 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:29,906 DEBUG [RS:1;jenkins-hbase4:45341] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2038a2 to 127.0.0.1:64894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:29,906 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:29,908 DEBUG [RS:0;jenkins-hbase4:41677] zookeeper.ReadOnlyZKClient(139): Connect 0x7963e932 to 127.0.0.1:64894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:29,918 DEBUG [RS:1;jenkins-hbase4:45341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e7c7b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:29,918 DEBUG [RS:0;jenkins-hbase4:41677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77a4086e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:29,918 DEBUG [RS:1;jenkins-hbase4:45341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d853d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:29,918 DEBUG [RS:0;jenkins-hbase4:41677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739b8242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:29,933 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45341 2023-02-16 09:00:29,933 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41677 2023-02-16 09:00:29,933 INFO [RS:1;jenkins-hbase4:45341] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:29,933 INFO [RS:0;jenkins-hbase4:41677] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:29,933 INFO [RS:0;jenkins-hbase4:41677] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:29,933 INFO [RS:1;jenkins-hbase4:45341] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:29,933 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:29,933 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:29,934 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45373,1676538029555 with isa=jenkins-hbase4.apache.org/172.31.14.131:45341, startcode=1676538029672 2023-02-16 09:00:29,934 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45373,1676538029555 with isa=jenkins-hbase4.apache.org/172.31.14.131:41677, startcode=1676538029631 2023-02-16 09:00:29,934 DEBUG [RS:1;jenkins-hbase4:45341] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:29,934 DEBUG [RS:0;jenkins-hbase4:41677] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:29,939 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58119, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:29,939 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55615, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:29,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45373] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,942 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b 2023-02-16 09:00:29,942 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b 2023-02-16 09:00:29,942 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35125 2023-02-16 09:00:29,942 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35125 2023-02-16 09:00:29,942 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:29,942 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:29,945 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:29,946 DEBUG [RS:0;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,946 DEBUG [RS:1;jenkins-hbase4:45341] zookeeper.ZKUtil(162): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,946 WARN [RS:0;jenkins-hbase4:41677] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:29,946 WARN [RS:1;jenkins-hbase4:45341] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:29,946 INFO [RS:0;jenkins-hbase4:41677] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:29,946 INFO [RS:1;jenkins-hbase4:45341] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:29,946 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,946 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,946 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41677,1676538029631] 2023-02-16 09:00:29,946 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45341,1676538029672] 2023-02-16 09:00:29,952 DEBUG [RS:1;jenkins-hbase4:45341] zookeeper.ZKUtil(162): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,952 DEBUG [RS:0;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,953 DEBUG [RS:1;jenkins-hbase4:45341] zookeeper.ZKUtil(162): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,953 DEBUG [RS:0;jenkins-hbase4:41677] zookeeper.ZKUtil(162): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,954 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:29,954 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:29,954 INFO [RS:0;jenkins-hbase4:41677] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:29,954 INFO [RS:1;jenkins-hbase4:45341] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:29,955 INFO [RS:0;jenkins-hbase4:41677] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:29,959 INFO [RS:0;jenkins-hbase4:41677] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:29,959 INFO [RS:1;jenkins-hbase4:45341] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:29,959 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,959 INFO [RS:1;jenkins-hbase4:45341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:29,959 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,960 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:29,960 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:29,961 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,961 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,961 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,962 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:29,963 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:29,963 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:0;jenkins-hbase4:41677] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,963 DEBUG [RS:1;jenkins-hbase4:45341] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:29,966 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,966 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,967 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,967 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,967 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,967 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,981 INFO [RS:0;jenkins-hbase4:41677] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:29,981 INFO [RS:1;jenkins-hbase4:45341] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:29,981 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41677,1676538029631-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,981 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45341,1676538029672-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:29,996 INFO [RS:1;jenkins-hbase4:45341] regionserver.Replication(203): jenkins-hbase4.apache.org,45341,1676538029672 started 2023-02-16 09:00:29,997 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45341,1676538029672, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45341, sessionid=0x1005c5c0f9a0002 2023-02-16 09:00:29,997 INFO [RS:0;jenkins-hbase4:41677] regionserver.Replication(203): jenkins-hbase4.apache.org,41677,1676538029631 started 2023-02-16 09:00:29,997 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:29,997 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41677,1676538029631, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41677, sessionid=0x1005c5c0f9a0001 2023-02-16 09:00:29,997 DEBUG [RS:1;jenkins-hbase4:45341] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,997 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:29,997 DEBUG [RS:0;jenkins-hbase4:41677] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,997 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45341,1676538029672' 2023-02-16 09:00:29,997 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:29,997 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41677,1676538029631' 2023-02-16 09:00:29,997 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:29,997 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45341,1676538029672' 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41677,1676538029631' 2023-02-16 09:00:29,998 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:29,998 DEBUG [RS:1;jenkins-hbase4:45341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:29,999 DEBUG [RS:0;jenkins-hbase4:41677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:29,999 DEBUG [RS:1;jenkins-hbase4:45341] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:29,999 INFO [RS:1;jenkins-hbase4:45341] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:29,999 DEBUG [RS:0;jenkins-hbase4:41677] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:29,999 INFO [RS:1;jenkins-hbase4:45341] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:29,999 INFO [RS:0;jenkins-hbase4:41677] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:29,999 INFO [RS:0;jenkins-hbase4:41677] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:30,041 DEBUG [jenkins-hbase4:45373] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:30,042 DEBUG [jenkins-hbase4:45373] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:30,044 DEBUG [jenkins-hbase4:45373] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:30,044 DEBUG [jenkins-hbase4:45373] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:30,044 DEBUG [jenkins-hbase4:45373] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:30,045 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45341,1676538029672, state=OPENING 2023-02-16 09:00:30,047 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:30,048 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:30,048 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:30,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:30,202 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:30,203 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:30,205 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48600, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:30,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:30,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:30,211 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45341%2C1676538029672.meta, suffix=.meta, logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672, archiveDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs, maxLogs=32 2023-02-16 09:00:30,228 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK] 2023-02-16 09:00:30,232 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK] 2023-02-16 09:00:30,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672/jenkins-hbase4.apache.org%2C45341%2C1676538029672.meta.1676538030212.meta 2023-02-16 09:00:30,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK], DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK]] 2023-02-16 09:00:30,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:30,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:30,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:30,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:30,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:30,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:30,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:30,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:30,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:30,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/info 2023-02-16 09:00:30,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/info 2023-02-16 09:00:30,241 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:30,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:30,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:30,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:30,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:30,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:30,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:30,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:30,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/table 2023-02-16 09:00:30,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/table 2023-02-16 09:00:30,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:30,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:30,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740 2023-02-16 09:00:30,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740 2023-02-16 09:00:30,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:30,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:30,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63673596, jitterRate=-0.05118948221206665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:30,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:30,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538030202 2023-02-16 09:00:30,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:30,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:30,260 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45341,1676538029672, state=OPEN 2023-02-16 09:00:30,262 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:30,262 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:30,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:30,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45341,1676538029672 in 214 msec 2023-02-16 09:00:30,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:30,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-02-16 09:00:30,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 432 msec 2023-02-16 09:00:30,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538030269, completionTime=-1 2023-02-16 09:00:30,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:30,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:30,271 DEBUG [hconnection-0x7ad83e2c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:30,273 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:30,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538090276 2023-02-16 09:00:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538150276 2023-02-16 09:00:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-16 09:00:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45373,1676538029555-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45373,1676538029555-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45373,1676538029555-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45373, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:30,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:30,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:30,286 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:30,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:30,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:30,289 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4 empty. 2023-02-16 09:00:30,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,290 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:30,307 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:30,308 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 648f95868ccbb65f1e29cdb882aeace4, NAME => 'hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:30,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:30,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 648f95868ccbb65f1e29cdb882aeace4, disabling compactions & flushes 2023-02-16 09:00:30,322 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. after waiting 0 ms 2023-02-16 09:00:30,322 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,323 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,323 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 648f95868ccbb65f1e29cdb882aeace4: 2023-02-16 09:00:30,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:30,326 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538030326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538030326"}]},"ts":"1676538030326"} 2023-02-16 09:00:30,329 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:30,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:30,330 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538030330"}]},"ts":"1676538030330"} 2023-02-16 09:00:30,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:30,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:30,336 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:30,336 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:30,336 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:30,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=648f95868ccbb65f1e29cdb882aeace4, ASSIGN}] 2023-02-16 09:00:30,339 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=648f95868ccbb65f1e29cdb882aeace4, ASSIGN 2023-02-16 09:00:30,339 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=648f95868ccbb65f1e29cdb882aeace4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:30,490 INFO [jenkins-hbase4:45373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:30,491 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=648f95868ccbb65f1e29cdb882aeace4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:30,491 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538030491"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538030491"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538030491"}]},"ts":"1676538030491"} 2023-02-16 09:00:30,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 648f95868ccbb65f1e29cdb882aeace4, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:30,649 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45341%2C1676538029672, suffix=, logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672, archiveDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs, maxLogs=32 2023-02-16 09:00:30,669 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK] 2023-02-16 09:00:30,671 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK] 2023-02-16 09:00:30,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672/jenkins-hbase4.apache.org%2C45341%2C1676538029672.1676538030651 2023-02-16 09:00:30,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK], DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK]] 2023-02-16 09:00:30,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 648f95868ccbb65f1e29cdb882aeace4, NAME => 'hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:30,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:30,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,677 INFO [StoreOpener-648f95868ccbb65f1e29cdb882aeace4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,679 DEBUG [StoreOpener-648f95868ccbb65f1e29cdb882aeace4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/info 2023-02-16 09:00:30,679 DEBUG [StoreOpener-648f95868ccbb65f1e29cdb882aeace4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/info 2023-02-16 09:00:30,679 INFO [StoreOpener-648f95868ccbb65f1e29cdb882aeace4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 648f95868ccbb65f1e29cdb882aeace4 columnFamilyName info 2023-02-16 09:00:30,680 INFO [StoreOpener-648f95868ccbb65f1e29cdb882aeace4-1] regionserver.HStore(310): Store=648f95868ccbb65f1e29cdb882aeace4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:30,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,684 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:30,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:30,686 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 648f95868ccbb65f1e29cdb882aeace4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72096733, jitterRate=0.07432503998279572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:30,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 648f95868ccbb65f1e29cdb882aeace4: 2023-02-16 09:00:30,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4., pid=6, masterSystemTime=1676538030645 2023-02-16 09:00:30,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,690 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:30,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=648f95868ccbb65f1e29cdb882aeace4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:30,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538030690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538030690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538030690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538030690"}]},"ts":"1676538030690"} 2023-02-16 09:00:30,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:30,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 648f95868ccbb65f1e29cdb882aeace4, server=jenkins-hbase4.apache.org,45341,1676538029672 in 199 msec 2023-02-16 09:00:30,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:30,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=648f95868ccbb65f1e29cdb882aeace4, ASSIGN in 358 msec 2023-02-16 09:00:30,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:30,697 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538030697"}]},"ts":"1676538030697"} 2023-02-16 09:00:30,698 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:30,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:30,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-02-16 09:00:30,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:30,788 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:30,788 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:30,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:30,801 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:30,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-16 09:00:30,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:30,822 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:30,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-16 09:00:30,847 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:30,849 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:30,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.145sec 2023-02-16 09:00:30,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:30,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:30,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:30,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45373,1676538029555-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:30,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45373,1676538029555-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:30,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:30,899 DEBUG [Listener at localhost/33217] zookeeper.ReadOnlyZKClient(139): Connect 0x6f797d2c to 127.0.0.1:64894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:30,922 DEBUG [Listener at localhost/33217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ff48352, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:30,925 DEBUG [hconnection-0x2f704f3d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:30,931 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:30,943 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:30,943 DEBUG [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:30,945 DEBUG [Listener at localhost/33217] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:30,950 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:30,950 INFO [Listener at localhost/33217] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 09:00:30,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 09:00:30,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:30,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:52886 deadline: 1676538090951, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 09:00:30,952 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 09:00:30,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:30,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 09:00:30,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:30,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 09:00:30,958 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:30,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:30,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:30,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:30,968 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:30,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad empty. 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937 empty. 2023-02-16 09:00:30,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28 empty. 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5 empty. 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946 empty. 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0 empty. 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3 empty. 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:30,970 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:30,971 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2 empty. 2023-02-16 09:00:30,971 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:30,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6 empty. 2023-02-16 09:00:30,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:30,971 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22 empty. 2023-02-16 09:00:30,972 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:30,972 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:30,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:30,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:30,972 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 09:00:30,985 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:30,986 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7d0a8ee0f981e80c3f5a154713317937, NAME => 'testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:30,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3bb702eba62460bba07cfcfd8a0889ad, NAME => 'testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:30,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 268089b36db308b8035c6069cf6655e3, NAME => 'testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,001 INFO [RS:0;jenkins-hbase4:41677] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41677%2C1676538029631, suffix=, logDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,41677,1676538029631, archiveDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs, maxLogs=32 2023-02-16 09:00:31,012 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,012 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3bb702eba62460bba07cfcfd8a0889ad, disabling compactions & flushes 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7d0a8ee0f981e80c3f5a154713317937, disabling compactions & flushes 2023-02-16 09:00:31,013 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,013 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. after waiting 0 ms 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. after waiting 0 ms 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,013 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:31,013 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:31,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 689cdeb8e05f838a3457945dd2afd8b5, NAME => 'testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c6ed804f13f0e847795cb68a5ca8ad28, NAME => 'testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 268089b36db308b8035c6069cf6655e3, disabling compactions & flushes 2023-02-16 09:00:31,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. after waiting 0 ms 2023-02-16 09:00:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:31,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1eefa54cccb21e4e6766986a3cda1ea0, NAME => 'testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,026 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK] 2023-02-16 09:00:31,026 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK] 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c6ed804f13f0e847795cb68a5ca8ad28, disabling compactions & flushes 2023-02-16 09:00:31,037 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,037 INFO [RS:0;jenkins-hbase4:41677] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,41677,1676538029631/jenkins-hbase4.apache.org%2C41677%2C1676538029631.1676538031002 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. after waiting 0 ms 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,037 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,037 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:31,037 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5085b12a4be94eb9e45954aaf4dba946, NAME => 'testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,038 DEBUG [RS:0;jenkins-hbase4:41677] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37447,DS-b824a579-eef7-4cc8-a35a-7ed0aab4f31e,DISK], DatanodeInfoWithStorage[127.0.0.1:45111,DS-5ed1bc54-127c-46be-a875-f5cff1faa3d7,DISK]] 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 689cdeb8e05f838a3457945dd2afd8b5, disabling compactions & flushes 2023-02-16 09:00:31,041 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. after waiting 0 ms 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,041 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1eefa54cccb21e4e6766986a3cda1ea0, disabling compactions & flushes 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:31,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea6a37f231fca2330be31e8947a0d5b2, NAME => 'testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. after waiting 0 ms 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:31,043 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3230af7caffd6ff274867da6cd052a22, NAME => 'testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ea6a37f231fca2330be31e8947a0d5b2, disabling compactions & flushes 2023-02-16 09:00:31,056 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. after waiting 0 ms 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,056 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:31,057 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa546f444ea61682a17b9b727d0899d6, NAME => 'testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.tmp 2023-02-16 09:00:31,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:31,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3230af7caffd6ff274867da6cd052a22, disabling compactions & flushes 2023-02-16 09:00:31,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. after waiting 0 ms 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5085b12a4be94eb9e45954aaf4dba946, disabling compactions & flushes 2023-02-16 09:00:31,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. after waiting 0 ms 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing aa546f444ea61682a17b9b727d0899d6, disabling compactions & flushes 2023-02-16 09:00:31,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. after waiting 0 ms 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,069 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:31,071 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538031072"}]},"ts":"1676538031072"} 2023-02-16 09:00:31,076 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 09:00:31,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:31,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538031078"}]},"ts":"1676538031078"} 2023-02-16 09:00:31,079 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 09:00:31,083 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:31,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:31,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:31,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:31,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d0a8ee0f981e80c3f5a154713317937, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=268089b36db308b8035c6069cf6655e3, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3bb702eba62460bba07cfcfd8a0889ad, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=689cdeb8e05f838a3457945dd2afd8b5, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c6ed804f13f0e847795cb68a5ca8ad28, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1eefa54cccb21e4e6766986a3cda1ea0, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5085b12a4be94eb9e45954aaf4dba946, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea6a37f231fca2330be31e8947a0d5b2, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3230af7caffd6ff274867da6cd052a22, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa546f444ea61682a17b9b727d0899d6, ASSIGN}] 2023-02-16 09:00:31,094 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa546f444ea61682a17b9b727d0899d6, ASSIGN 2023-02-16 09:00:31,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea6a37f231fca2330be31e8947a0d5b2, ASSIGN 2023-02-16 09:00:31,094 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3230af7caffd6ff274867da6cd052a22, ASSIGN 2023-02-16 09:00:31,095 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5085b12a4be94eb9e45954aaf4dba946, ASSIGN 2023-02-16 09:00:31,095 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1eefa54cccb21e4e6766986a3cda1ea0, ASSIGN 2023-02-16 09:00:31,095 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ea6a37f231fca2330be31e8947a0d5b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:31,095 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3230af7caffd6ff274867da6cd052a22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41677,1676538029631; forceNewPlan=false, retain=false 2023-02-16 09:00:31,095 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5085b12a4be94eb9e45954aaf4dba946, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:31,095 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aa546f444ea61682a17b9b727d0899d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41677,1676538029631; forceNewPlan=false, retain=false 2023-02-16 09:00:31,096 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1eefa54cccb21e4e6766986a3cda1ea0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41677,1676538029631; forceNewPlan=false, retain=false 2023-02-16 09:00:31,096 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c6ed804f13f0e847795cb68a5ca8ad28, ASSIGN 2023-02-16 09:00:31,097 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=689cdeb8e05f838a3457945dd2afd8b5, ASSIGN 2023-02-16 09:00:31,097 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3bb702eba62460bba07cfcfd8a0889ad, ASSIGN 2023-02-16 09:00:31,097 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=268089b36db308b8035c6069cf6655e3, ASSIGN 2023-02-16 09:00:31,097 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c6ed804f13f0e847795cb68a5ca8ad28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41677,1676538029631; forceNewPlan=false, retain=false 2023-02-16 09:00:31,097 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d0a8ee0f981e80c3f5a154713317937, ASSIGN 2023-02-16 09:00:31,098 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=689cdeb8e05f838a3457945dd2afd8b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:31,098 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3bb702eba62460bba07cfcfd8a0889ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41677,1676538029631; forceNewPlan=false, retain=false 2023-02-16 09:00:31,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=268089b36db308b8035c6069cf6655e3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:31,099 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7d0a8ee0f981e80c3f5a154713317937, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45341,1676538029672; forceNewPlan=false, retain=false 2023-02-16 09:00:31,246 INFO [jenkins-hbase4:45373] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 09:00:31,249 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=268089b36db308b8035c6069cf6655e3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,249 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ea6a37f231fca2330be31e8947a0d5b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,249 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7d0a8ee0f981e80c3f5a154713317937, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,250 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031249"}]},"ts":"1676538031249"} 2023-02-16 09:00:31,249 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5085b12a4be94eb9e45954aaf4dba946, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031249"}]},"ts":"1676538031249"} 2023-02-16 09:00:31,250 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031249"}]},"ts":"1676538031249"} 2023-02-16 09:00:31,250 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031249"}]},"ts":"1676538031249"} 2023-02-16 09:00:31,249 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=689cdeb8e05f838a3457945dd2afd8b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031249"}]},"ts":"1676538031249"} 2023-02-16 09:00:31,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 268089b36db308b8035c6069cf6655e3, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:31,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure ea6a37f231fca2330be31e8947a0d5b2, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:31,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 5085b12a4be94eb9e45954aaf4dba946, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:31,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 7d0a8ee0f981e80c3f5a154713317937, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:31,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 689cdeb8e05f838a3457945dd2afd8b5, server=jenkins-hbase4.apache.org,45341,1676538029672}] 2023-02-16 09:00:31,258 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3230af7caffd6ff274867da6cd052a22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,258 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031258"}]},"ts":"1676538031258"} 2023-02-16 09:00:31,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3bb702eba62460bba07cfcfd8a0889ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031258"}]},"ts":"1676538031258"} 2023-02-16 09:00:31,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 3230af7caffd6ff274867da6cd052a22, server=jenkins-hbase4.apache.org,41677,1676538029631}] 2023-02-16 09:00:31,263 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aa546f444ea61682a17b9b727d0899d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031263"}]},"ts":"1676538031263"} 2023-02-16 09:00:31,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:31,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 3bb702eba62460bba07cfcfd8a0889ad, server=jenkins-hbase4.apache.org,41677,1676538029631}] 2023-02-16 09:00:31,264 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c6ed804f13f0e847795cb68a5ca8ad28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,265 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031264"}]},"ts":"1676538031264"} 2023-02-16 09:00:31,265 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1eefa54cccb21e4e6766986a3cda1ea0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure aa546f444ea61682a17b9b727d0899d6, server=jenkins-hbase4.apache.org,41677,1676538029631}] 2023-02-16 09:00:31,266 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538031264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538031264"}]},"ts":"1676538031264"} 2023-02-16 09:00:31,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure c6ed804f13f0e847795cb68a5ca8ad28, server=jenkins-hbase4.apache.org,41677,1676538029631}] 2023-02-16 09:00:31,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 1eefa54cccb21e4e6766986a3cda1ea0, server=jenkins-hbase4.apache.org,41677,1676538029631}] 2023-02-16 09:00:31,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7d0a8ee0f981e80c3f5a154713317937, NAME => 'testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 09:00:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,410 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,412 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f1 2023-02-16 09:00:31,412 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f1 2023-02-16 09:00:31,412 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d0a8ee0f981e80c3f5a154713317937 columnFamilyName f1 2023-02-16 09:00:31,413 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(310): Store=7d0a8ee0f981e80c3f5a154713317937/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,413 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,414 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f2 2023-02-16 09:00:31,414 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f2 2023-02-16 09:00:31,414 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d0a8ee0f981e80c3f5a154713317937 columnFamilyName f2 2023-02-16 09:00:31,415 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(310): Store=7d0a8ee0f981e80c3f5a154713317937/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,416 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,416 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:31,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,421 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:31,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:31,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7d0a8ee0f981e80c3f5a154713317937; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64150694, jitterRate=-0.04408016800880432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3bb702eba62460bba07cfcfd8a0889ad, NAME => 'testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 09:00:31,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:31,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937., pid=24, masterSystemTime=1676538031405 2023-02-16 09:00:31,427 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7d0a8ee0f981e80c3f5a154713317937, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031428"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031428"}]},"ts":"1676538031428"} 2023-02-16 09:00:31,428 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1 2023-02-16 09:00:31,428 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1 2023-02-16 09:00:31,428 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb702eba62460bba07cfcfd8a0889ad columnFamilyName f1 2023-02-16 09:00:31,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:31,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ea6a37f231fca2330be31e8947a0d5b2, NAME => 'testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 09:00:31,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,430 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(310): Store=3bb702eba62460bba07cfcfd8a0889ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,430 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,431 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-16 09:00:31,432 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2 2023-02-16 09:00:31,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 7d0a8ee0f981e80c3f5a154713317937, server=jenkins-hbase4.apache.org,45341,1676538029672 in 174 msec 2023-02-16 09:00:31,432 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2 2023-02-16 09:00:31,433 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb702eba62460bba07cfcfd8a0889ad columnFamilyName f2 2023-02-16 09:00:31,433 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(310): Store=3bb702eba62460bba07cfcfd8a0889ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d0a8ee0f981e80c3f5a154713317937, ASSIGN in 341 msec 2023-02-16 09:00:31,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:31,440 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1 2023-02-16 09:00:31,440 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1 2023-02-16 09:00:31,440 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea6a37f231fca2330be31e8947a0d5b2 columnFamilyName f1 2023-02-16 09:00:31,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,441 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(310): Store=ea6a37f231fca2330be31e8947a0d5b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3bb702eba62460bba07cfcfd8a0889ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62639363, jitterRate=-0.0666007548570633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,441 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:31,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad., pid=27, masterSystemTime=1676538031416 2023-02-16 09:00:31,444 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2 2023-02-16 09:00:31,444 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2 2023-02-16 09:00:31,444 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea6a37f231fca2330be31e8947a0d5b2 columnFamilyName f2 2023-02-16 09:00:31,445 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(310): Store=ea6a37f231fca2330be31e8947a0d5b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa546f444ea61682a17b9b727d0899d6, NAME => 'testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 09:00:31,446 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3bb702eba62460bba07cfcfd8a0889ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,446 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031446"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031446"}]},"ts":"1676538031446"} 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,448 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,449 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f1 2023-02-16 09:00:31,449 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f1 2023-02-16 09:00:31,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,450 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa546f444ea61682a17b9b727d0899d6 columnFamilyName f1 2023-02-16 09:00:31,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-16 09:00:31,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 3bb702eba62460bba07cfcfd8a0889ad, server=jenkins-hbase4.apache.org,41677,1676538029631 in 185 msec 2023-02-16 09:00:31,450 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(310): Store=aa546f444ea61682a17b9b727d0899d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,451 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:31,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3bb702eba62460bba07cfcfd8a0889ad, ASSIGN in 359 msec 2023-02-16 09:00:31,452 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f2 2023-02-16 09:00:31,452 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f2 2023-02-16 09:00:31,452 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa546f444ea61682a17b9b727d0899d6 columnFamilyName f2 2023-02-16 09:00:31,453 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(310): Store=aa546f444ea61682a17b9b727d0899d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ea6a37f231fca2330be31e8947a0d5b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71176805, jitterRate=0.06061704456806183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:31,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2., pid=22, masterSystemTime=1676538031405 2023-02-16 09:00:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 268089b36db308b8035c6069cf6655e3, NAME => 'testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 09:00:31,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ea6a37f231fca2330be31e8947a0d5b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,457 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031456"}]},"ts":"1676538031456"} 2023-02-16 09:00:31,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:31,458 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-16 09:00:31,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure ea6a37f231fca2330be31e8947a0d5b2, server=jenkins-hbase4.apache.org,45341,1676538029672 in 205 msec 2023-02-16 09:00:31,461 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1 2023-02-16 09:00:31,461 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1 2023-02-16 09:00:31,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa546f444ea61682a17b9b727d0899d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61010854, jitterRate=-0.09086742997169495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,461 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 268089b36db308b8035c6069cf6655e3 columnFamilyName f1 2023-02-16 09:00:31,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:31,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ea6a37f231fca2330be31e8947a0d5b2, ASSIGN in 369 msec 2023-02-16 09:00:31,462 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(310): Store=268089b36db308b8035c6069cf6655e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,462 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6., pid=28, masterSystemTime=1676538031416 2023-02-16 09:00:31,463 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2 2023-02-16 09:00:31,463 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2 2023-02-16 09:00:31,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,464 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 268089b36db308b8035c6069cf6655e3 columnFamilyName f2 2023-02-16 09:00:31,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1eefa54cccb21e4e6766986a3cda1ea0, NAME => 'testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 09:00:31,464 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aa546f444ea61682a17b9b727d0899d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,464 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676538031464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031464"}]},"ts":"1676538031464"} 2023-02-16 09:00:31,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,465 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(310): Store=268089b36db308b8035c6069cf6655e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,466 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,467 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1 2023-02-16 09:00:31,467 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1 2023-02-16 09:00:31,468 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eefa54cccb21e4e6766986a3cda1ea0 columnFamilyName f1 2023-02-16 09:00:31,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-16 09:00:31,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure aa546f444ea61682a17b9b727d0899d6, server=jenkins-hbase4.apache.org,41677,1676538029631 in 200 msec 2023-02-16 09:00:31,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,469 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(310): Store=1eefa54cccb21e4e6766986a3cda1ea0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,469 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aa546f444ea61682a17b9b727d0899d6, ASSIGN in 377 msec 2023-02-16 09:00:31,470 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2 2023-02-16 09:00:31,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:31,470 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2 2023-02-16 09:00:31,470 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eefa54cccb21e4e6766986a3cda1ea0 columnFamilyName f2 2023-02-16 09:00:31,471 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(310): Store=1eefa54cccb21e4e6766986a3cda1ea0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 268089b36db308b8035c6069cf6655e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66903388, jitterRate=-0.003061830997467041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:31,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3., pid=21, masterSystemTime=1676538031405 2023-02-16 09:00:31,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5085b12a4be94eb9e45954aaf4dba946, NAME => 'testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 09:00:31,476 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=268089b36db308b8035c6069cf6655e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,476 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031476"}]},"ts":"1676538031476"} 2023-02-16 09:00:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,478 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-16 09:00:31,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 268089b36db308b8035c6069cf6655e3, server=jenkins-hbase4.apache.org,45341,1676538029672 in 226 msec 2023-02-16 09:00:31,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=268089b36db308b8035c6069cf6655e3, ASSIGN in 388 msec 2023-02-16 09:00:31,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,485 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1 2023-02-16 09:00:31,485 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1 2023-02-16 09:00:31,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1eefa54cccb21e4e6766986a3cda1ea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74405805, jitterRate=0.10873289406299591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:31,485 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5085b12a4be94eb9e45954aaf4dba946 columnFamilyName f1 2023-02-16 09:00:31,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0., pid=30, masterSystemTime=1676538031416 2023-02-16 09:00:31,486 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(310): Store=5085b12a4be94eb9e45954aaf4dba946/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,486 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,487 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2 2023-02-16 09:00:31,487 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2 2023-02-16 09:00:31,488 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5085b12a4be94eb9e45954aaf4dba946 columnFamilyName f2 2023-02-16 09:00:31,488 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(310): Store=5085b12a4be94eb9e45954aaf4dba946/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:31,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,489 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1eefa54cccb21e4e6766986a3cda1ea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3230af7caffd6ff274867da6cd052a22, NAME => 'testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 09:00:31,489 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031489"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031489"}]},"ts":"1676538031489"} 2023-02-16 09:00:31,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,492 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-16 09:00:31,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 1eefa54cccb21e4e6766986a3cda1ea0, server=jenkins-hbase4.apache.org,41677,1676538029631 in 221 msec 2023-02-16 09:00:31,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1eefa54cccb21e4e6766986a3cda1ea0, ASSIGN in 402 msec 2023-02-16 09:00:31,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:31,495 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1 2023-02-16 09:00:31,495 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1 2023-02-16 09:00:31,496 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3230af7caffd6ff274867da6cd052a22 columnFamilyName f1 2023-02-16 09:00:31,496 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(310): Store=3230af7caffd6ff274867da6cd052a22/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,496 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,497 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2 2023-02-16 09:00:31,497 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2 2023-02-16 09:00:31,498 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3230af7caffd6ff274867da6cd052a22 columnFamilyName f2 2023-02-16 09:00:31,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,498 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(310): Store=3230af7caffd6ff274867da6cd052a22/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5085b12a4be94eb9e45954aaf4dba946; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69784696, jitterRate=0.03987300395965576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:31,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:31,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3230af7caffd6ff274867da6cd052a22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60662706, jitterRate=-0.09605523943901062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:31,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946., pid=23, masterSystemTime=1676538031405 2023-02-16 09:00:31,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22., pid=26, masterSystemTime=1676538031416 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:31,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 689cdeb8e05f838a3457945dd2afd8b5, NAME => 'testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 09:00:31,508 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5085b12a4be94eb9e45954aaf4dba946, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,508 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031508"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031508"}]},"ts":"1676538031508"} 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c6ed804f13f0e847795cb68a5ca8ad28, NAME => 'testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 09:00:31,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:31,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,509 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3230af7caffd6ff274867da6cd052a22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031509"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031509"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031509"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031509"}]},"ts":"1676538031509"} 2023-02-16 09:00:31,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-16 09:00:31,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 5085b12a4be94eb9e45954aaf4dba946, server=jenkins-hbase4.apache.org,45341,1676538029672 in 257 msec 2023-02-16 09:00:31,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-16 09:00:31,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 3230af7caffd6ff274867da6cd052a22, server=jenkins-hbase4.apache.org,41677,1676538029631 in 251 msec 2023-02-16 09:00:31,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5085b12a4be94eb9e45954aaf4dba946, ASSIGN in 423 msec 2023-02-16 09:00:31,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3230af7caffd6ff274867da6cd052a22, ASSIGN in 424 msec 2023-02-16 09:00:31,520 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,520 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,522 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1 2023-02-16 09:00:31,522 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1 2023-02-16 09:00:31,522 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1 2023-02-16 09:00:31,522 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1 2023-02-16 09:00:31,522 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6ed804f13f0e847795cb68a5ca8ad28 columnFamilyName f1 2023-02-16 09:00:31,522 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 689cdeb8e05f838a3457945dd2afd8b5 columnFamilyName f1 2023-02-16 09:00:31,523 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(310): Store=689cdeb8e05f838a3457945dd2afd8b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,523 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(310): Store=c6ed804f13f0e847795cb68a5ca8ad28/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,523 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,523 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,524 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2 2023-02-16 09:00:31,525 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2 2023-02-16 09:00:31,525 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2 2023-02-16 09:00:31,525 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2 2023-02-16 09:00:31,525 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6ed804f13f0e847795cb68a5ca8ad28 columnFamilyName f2 2023-02-16 09:00:31,525 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 689cdeb8e05f838a3457945dd2afd8b5 columnFamilyName f2 2023-02-16 09:00:31,525 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(310): Store=c6ed804f13f0e847795cb68a5ca8ad28/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,526 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(310): Store=689cdeb8e05f838a3457945dd2afd8b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:31,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:31,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:31,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:31,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c6ed804f13f0e847795cb68a5ca8ad28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72182298, jitterRate=0.07560005784034729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:31,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:31,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 689cdeb8e05f838a3457945dd2afd8b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75123598, jitterRate=0.1194288432598114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:31,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:31,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28., pid=29, masterSystemTime=1676538031416 2023-02-16 09:00:31,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5., pid=25, masterSystemTime=1676538031405 2023-02-16 09:00:31,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,545 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c6ed804f13f0e847795cb68a5ca8ad28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031545"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031545"}]},"ts":"1676538031545"} 2023-02-16 09:00:31,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=689cdeb8e05f838a3457945dd2afd8b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,546 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676538031546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538031546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538031546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538031546"}]},"ts":"1676538031546"} 2023-02-16 09:00:31,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-16 09:00:31,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure c6ed804f13f0e847795cb68a5ca8ad28, server=jenkins-hbase4.apache.org,41677,1676538029631 in 279 msec 2023-02-16 09:00:31,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c6ed804f13f0e847795cb68a5ca8ad28, ASSIGN in 458 msec 2023-02-16 09:00:31,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-16 09:00:31,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 689cdeb8e05f838a3457945dd2afd8b5, server=jenkins-hbase4.apache.org,45341,1676538029672 in 292 msec 2023-02-16 09:00:31,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-16 09:00:31,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=689cdeb8e05f838a3457945dd2afd8b5, ASSIGN in 459 msec 2023-02-16 09:00:31,552 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:31,553 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538031552"}]},"ts":"1676538031552"} 2023-02-16 09:00:31,554 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 09:00:31,556 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:31,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 602 msec 2023-02-16 09:00:31,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:31,566 INFO [Listener at localhost/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 09:00:31,566 DEBUG [Listener at localhost/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 09:00:31,566 INFO [Listener at localhost/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:31,570 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 09:00:31,570 INFO [Listener at localhost/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:31,570 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 09:00:31,570 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:31,618 DEBUG [hconnection-0x2f704f3d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:31,636 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45341] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,639 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:31,649 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41677] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,728 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:31,728 INFO [Listener at localhost/33217] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:31,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538031729 (current time:1676538031729). 2023-02-16 09:00:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:31,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] zookeeper.ReadOnlyZKClient(139): Connect 0x64254ae2 to 127.0.0.1:64894 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:31,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276f767b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:31,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:31,743 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:31,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64254ae2 to 127.0.0.1:64894 2023-02-16 09:00:31,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:31,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:31,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:31,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:31,750 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:31,751 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676538631751 2023-02-16 09:00:31,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:00:31,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 09:00:31,752 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:31,752 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:31,753 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:00:31,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:31,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-16 09:00:31,754 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:31,755 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676538631755 2023-02-16 09:00:31,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,771 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-16 09:00:31,771 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:31,772 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-16 09:00:31,772 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-16 09:00:31,773 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,773 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,776 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:31,776 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:31,776 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,777 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,777 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,777 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,777 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 09:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,784 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 09:00:31,784 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:31,786 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 09:00:31,786 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 09:00:31,786 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 09:00:31,786 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45341,1676538029672' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 09:00:31,786 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:31,787 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 09:00:31,787 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 09:00:31,787 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41677,1676538029631' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 09:00:31,789 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,789 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,791 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:31,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:31,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45341,1676538029672' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@756b84f0[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:31,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:31,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:31,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41677,1676538029631' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 09:00:31,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@756b84f0[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:31,799 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-16 09:00:31,799 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:31,805 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,806 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:31,806 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:31,806 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:31,808 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:31,808 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:31,808 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. started... 2023-02-16 09:00:31,813 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3230af7caffd6ff274867da6cd052a22 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:31,813 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:31,813 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. started... 2023-02-16 09:00:31,816 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:31,816 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:31,816 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. started... 2023-02-16 09:00:31,816 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. started... 2023-02-16 09:00:31,819 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:31,819 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:31,819 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,819 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. started... 2023-02-16 09:00:31,821 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ea6a37f231fca2330be31e8947a0d5b2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:31,821 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3bb702eba62460bba07cfcfd8a0889ad 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:31,823 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:31,823 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. started... 2023-02-16 09:00:31,824 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 268089b36db308b8035c6069cf6655e3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:31,827 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:31,827 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 689cdeb8e05f838a3457945dd2afd8b5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:31,827 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,827 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:31,827 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:31,827 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:31,852 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:31,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:31,856 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:31,882 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f1/e7e9d25aaea14ce5909a8249ca6e9ee1 2023-02-16 09:00:31,884 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f1/c9fbb6f906a646c3a029750d0e19934c 2023-02-16 09:00:31,896 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f1/34a4bdb8d6944cb88830a879361a8886 2023-02-16 09:00:31,912 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f1/6b0068a7b0c049c9a24bb58dde61fa2e 2023-02-16 09:00:31,916 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. completed. 2023-02-16 09:00:31,916 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:31,916 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:31,916 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:31,916 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. started... 2023-02-16 09:00:31,919 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c6ed804f13f0e847795cb68a5ca8ad28 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:31,937 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f1/6f8036993054427c8fb2f668f8bc129d 2023-02-16 09:00:31,961 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f2/4f11a59914c446f685e1dc39151dfa69 2023-02-16 09:00:31,963 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f2/12a6d890db024bf8aa793a0567854022 2023-02-16 09:00:31,968 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f1/34a4bdb8d6944cb88830a879361a8886 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/34a4bdb8d6944cb88830a879361a8886 2023-02-16 09:00:31,969 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f1/c9fbb6f906a646c3a029750d0e19934c as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c9fbb6f906a646c3a029750d0e19934c 2023-02-16 09:00:31,974 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/34a4bdb8d6944cb88830a879361a8886, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:31,975 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c9fbb6f906a646c3a029750d0e19934c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:31,975 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f2/4f11a59914c446f685e1dc39151dfa69 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/4f11a59914c446f685e1dc39151dfa69 2023-02-16 09:00:31,976 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f2/12a6d890db024bf8aa793a0567854022 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/12a6d890db024bf8aa793a0567854022 2023-02-16 09:00:31,987 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f1/3703fe279f1f4a14a27b90985ec63019 2023-02-16 09:00:31,995 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/12a6d890db024bf8aa793a0567854022, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:31,996 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ea6a37f231fca2330be31e8947a0d5b2 in 175ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:31,996 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c9fbb6f906a646c3a029750d0e19934c] hfiles 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c9fbb6f906a646c3a029750d0e19934c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/12a6d890db024bf8aa793a0567854022] hfiles 2023-02-16 09:00:31,997 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/12a6d890db024bf8aa793a0567854022 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,008 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f2/b2812df6397a4dfc82adf4410edffbbd 2023-02-16 09:00:32,009 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/4f11a59914c446f685e1dc39151dfa69, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:32,010 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3230af7caffd6ff274867da6cd052a22 in 197ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,019 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/34a4bdb8d6944cb88830a879361a8886] hfiles 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/34a4bdb8d6944cb88830a879361a8886 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/4f11a59914c446f685e1dc39151dfa69] hfiles 2023-02-16 09:00:32,020 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/4f11a59914c446f685e1dc39151dfa69 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,032 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f2/dd65201ac8a1461194f159ae092e326d 2023-02-16 09:00:32,034 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f1/e7e9d25aaea14ce5909a8249ca6e9ee1 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/e7e9d25aaea14ce5909a8249ca6e9ee1 2023-02-16 09:00:32,039 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f1/6f8036993054427c8fb2f668f8bc129d as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/6f8036993054427c8fb2f668f8bc129d 2023-02-16 09:00:32,049 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/6f8036993054427c8fb2f668f8bc129d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,049 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f2/dd65201ac8a1461194f159ae092e326d as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/dd65201ac8a1461194f159ae092e326d 2023-02-16 09:00:32,051 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/e7e9d25aaea14ce5909a8249ca6e9ee1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,053 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f2/b2812df6397a4dfc82adf4410edffbbd as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/b2812df6397a4dfc82adf4410edffbbd 2023-02-16 09:00:32,057 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:32,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:32,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:32,058 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 09:00:32,061 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/dd65201ac8a1461194f159ae092e326d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,062 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3bb702eba62460bba07cfcfd8a0889ad in 240ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/6f8036993054427c8fb2f668f8bc129d] hfiles 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/6f8036993054427c8fb2f668f8bc129d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/dd65201ac8a1461194f159ae092e326d] hfiles 2023-02-16 09:00:32,062 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/dd65201ac8a1461194f159ae092e326d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,069 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/b2812df6397a4dfc82adf4410edffbbd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,070 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 689cdeb8e05f838a3457945dd2afd8b5 in 243ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/e7e9d25aaea14ce5909a8249ca6e9ee1] hfiles 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/e7e9d25aaea14ce5909a8249ca6e9ee1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/b2812df6397a4dfc82adf4410edffbbd] hfiles 2023-02-16 09:00:32,070 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/b2812df6397a4dfc82adf4410edffbbd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,096 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. completed. 2023-02-16 09:00:32,096 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:32,096 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:32,096 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. started... 2023-02-16 09:00:32,096 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:32,097 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,097 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,097 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:32,097 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. completed. 2023-02-16 09:00:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. started... 2023-02-16 09:00:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:32,104 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1eefa54cccb21e4e6766986a3cda1ea0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:32,128 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f2/efae9a1e76e447948d586ee5ee82ed51 2023-02-16 09:00:32,131 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. completed. 2023-02-16 09:00:32,131 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:32,131 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:32,131 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. started... 2023-02-16 09:00:32,132 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5085b12a4be94eb9e45954aaf4dba946 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:32,132 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:32,136 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. completed. 2023-02-16 09:00:32,136 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:32,140 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f1/3703fe279f1f4a14a27b90985ec63019 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3703fe279f1f4a14a27b90985ec63019 2023-02-16 09:00:32,145 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3703fe279f1f4a14a27b90985ec63019, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,146 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f2/efae9a1e76e447948d586ee5ee82ed51 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/efae9a1e76e447948d586ee5ee82ed51 2023-02-16 09:00:32,148 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f1/5db082e7d47544589690eead063cb390 2023-02-16 09:00:32,152 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/efae9a1e76e447948d586ee5ee82ed51, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,152 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. completed. 2023-02-16 09:00:32,152 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:32,153 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c6ed804f13f0e847795cb68a5ca8ad28 in 234ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,153 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:32,153 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,153 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,153 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3703fe279f1f4a14a27b90985ec63019] hfiles 2023-02-16 09:00:32,154 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3703fe279f1f4a14a27b90985ec63019 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,154 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/efae9a1e76e447948d586ee5ee82ed51] hfiles 2023-02-16 09:00:32,154 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/efae9a1e76e447948d586ee5ee82ed51 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,168 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f1/ceb6267684964e8f86fa9b7fdf0c010c 2023-02-16 09:00:32,180 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. completed. 2023-02-16 09:00:32,180 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:32,180 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:32,193 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f2/5d7a4b02983247c2b65a433af0994dc3 2023-02-16 09:00:32,203 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f1/5db082e7d47544589690eead063cb390 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/5db082e7d47544589690eead063cb390 2023-02-16 09:00:32,204 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f2/cf82b5f85d1641268ecdcd14774a05e6 2023-02-16 09:00:32,209 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/5db082e7d47544589690eead063cb390, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,210 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f2/5d7a4b02983247c2b65a433af0994dc3 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/5d7a4b02983247c2b65a433af0994dc3 2023-02-16 09:00:32,210 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f1/ceb6267684964e8f86fa9b7fdf0c010c as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/ceb6267684964e8f86fa9b7fdf0c010c 2023-02-16 09:00:32,219 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/5d7a4b02983247c2b65a433af0994dc3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,219 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/ceb6267684964e8f86fa9b7fdf0c010c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,220 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1eefa54cccb21e4e6766986a3cda1ea0 in 116ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f2/cf82b5f85d1641268ecdcd14774a05e6 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/cf82b5f85d1641268ecdcd14774a05e6 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/5db082e7d47544589690eead063cb390] hfiles 2023-02-16 09:00:32,220 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/5db082e7d47544589690eead063cb390 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,221 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/5d7a4b02983247c2b65a433af0994dc3] hfiles 2023-02-16 09:00:32,221 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/5d7a4b02983247c2b65a433af0994dc3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,226 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/cf82b5f85d1641268ecdcd14774a05e6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:32,227 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5085b12a4be94eb9e45954aaf4dba946 in 95ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,227 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/ceb6267684964e8f86fa9b7fdf0c010c] hfiles 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/ceb6267684964e8f86fa9b7fdf0c010c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/cf82b5f85d1641268ecdcd14774a05e6] hfiles 2023-02-16 09:00:32,228 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/cf82b5f85d1641268ecdcd14774a05e6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,240 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. completed. 2023-02-16 09:00:32,240 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:32,240 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:32,240 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:32,240 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,240 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 09:00:32,240 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,41677,1676538029631' in zk 2023-02-16 09:00:32,244 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,244 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 09:00:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:32,244 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:32,244 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 09:00:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,251 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. completed. 2023-02-16 09:00:32,251 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:32,251 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,41677,1676538029631': 2023-02-16 09:00:32,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41677,1676538029631' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 09:00:32,358 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:32,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:32,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:32,361 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 09:00:32,404 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f2/4c8309fffa9743c3b44300ac57df35be 2023-02-16 09:00:32,411 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f1/6b0068a7b0c049c9a24bb58dde61fa2e as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/6b0068a7b0c049c9a24bb58dde61fa2e 2023-02-16 09:00:32,417 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/6b0068a7b0c049c9a24bb58dde61fa2e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:32,418 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f2/4c8309fffa9743c3b44300ac57df35be as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/4c8309fffa9743c3b44300ac57df35be 2023-02-16 09:00:32,434 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/4c8309fffa9743c3b44300ac57df35be, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:32,436 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 268089b36db308b8035c6069cf6655e3 in 612ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/6b0068a7b0c049c9a24bb58dde61fa2e] hfiles 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/6b0068a7b0c049c9a24bb58dde61fa2e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/4c8309fffa9743c3b44300ac57df35be] hfiles 2023-02-16 09:00:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/4c8309fffa9743c3b44300ac57df35be for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,446 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:00:32,455 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. completed. 2023-02-16 09:00:32,455 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 09:00:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,45341,1676538029672' in zk 2023-02-16 09:00:32,458 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 09:00:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 09:00:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:32,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:32,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,45341,1676538029672': 2023-02-16 09:00:32,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45341,1676538029672' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:32,463 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-16 09:00:32,463 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:32,463 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:32,463 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,463 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:32,467 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,467 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:32,467 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:32,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:32,468 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,470 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,470 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,470 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:32,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:32,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:32,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,477 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:32,477 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,492 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:32,492 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:32,492 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,492 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:32,493 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:32,493 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:32,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:32,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:32,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-16 09:00:32,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,599 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:32,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676538031751Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676538032493 (+742 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676538032494 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676538032537 (+43 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676538032560 (+23 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676538032599 (+39 ms) 2023-02-16 09:00:32,601 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:00:32,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 849 msec 2023-02-16 09:00:32,861 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:32,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:00:32,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:32,863 INFO [Listener at localhost/33217] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:32,869 INFO [Listener at localhost/33217] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:32,877 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:32,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41677] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:32,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45341] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,340 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:33,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:33,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 09:00:33,360 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 09:00:33,360 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:33,361 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 09:00:33,361 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 09:00:33,361 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,361 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,363 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,363 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:33,363 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:33,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:33,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:33,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:33,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:33,363 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,364 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,365 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,365 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,365 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:00:33,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:00:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,366 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:00:33,366 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:00:33,366 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:33,367 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:00:33,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:00:33,367 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,367 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. started... 2023-02-16 09:00:33,367 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3230af7caffd6ff274867da6cd052a22 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:33,369 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:00:33,369 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:33,375 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:00:33,375 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,375 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. started... 2023-02-16 09:00:33,376 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:33,376 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. started... 2023-02-16 09:00:33,376 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3bb702eba62460bba07cfcfd8a0889ad 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:33,376 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:33,376 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. started... 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. started... 2023-02-16 09:00:33,377 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ea6a37f231fca2330be31e8947a0d5b2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,377 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:33,377 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,377 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:33,377 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. started... 2023-02-16 09:00:33,377 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c6ed804f13f0e847795cb68a5ca8ad28 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:33,376 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. started... 2023-02-16 09:00:33,379 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 689cdeb8e05f838a3457945dd2afd8b5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,376 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 268089b36db308b8035c6069cf6655e3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:33,417 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f1/3a75143bd5104a4d8eaf65e0d12a6b2a 2023-02-16 09:00:33,440 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f1/6efc21b6a727499397002c66cfee2499 2023-02-16 09:00:33,452 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f1/c3961f26fb374fdfbf81173798277d32 2023-02-16 09:00:33,452 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f1/1d3ae9fc93514886818338747e0466bb 2023-02-16 09:00:33,456 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f1/fe26ead23a0a423d9de45441601f722e 2023-02-16 09:00:33,468 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f1/fb584b114a7d45cb8d7bef59112f0ef2 2023-02-16 09:00:33,482 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f2/e63d198bf11242efb83b15e429341bd2 2023-02-16 09:00:33,489 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f1/6efc21b6a727499397002c66cfee2499 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/6efc21b6a727499397002c66cfee2499 2023-02-16 09:00:33,496 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f2/7196d2e12bb44e219cab78f20d4cd5a7 2023-02-16 09:00:33,497 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/6efc21b6a727499397002c66cfee2499, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,498 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/.tmp/f2/e63d198bf11242efb83b15e429341bd2 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/e63d198bf11242efb83b15e429341bd2 2023-02-16 09:00:33,502 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f2/dc11bc92c6a9471a9161ce00e85877e7 2023-02-16 09:00:33,503 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f1/c3961f26fb374fdfbf81173798277d32 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c3961f26fb374fdfbf81173798277d32 2023-02-16 09:00:33,505 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/e63d198bf11242efb83b15e429341bd2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,506 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 689cdeb8e05f838a3457945dd2afd8b5 in 127ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,506 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:33,507 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:33,513 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f2/5852ae092bd24302b41dfaeda2677ec4 2023-02-16 09:00:33,513 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f1/3a75143bd5104a4d8eaf65e0d12a6b2a as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3a75143bd5104a4d8eaf65e0d12a6b2a 2023-02-16 09:00:33,513 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:33,513 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:33,513 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. started... 2023-02-16 09:00:33,513 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:33,513 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:33,513 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:33,514 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:33,514 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. started... 2023-02-16 09:00:33,514 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5085b12a4be94eb9e45954aaf4dba946 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,523 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/c3961f26fb374fdfbf81173798277d32, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,524 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/.tmp/f2/7196d2e12bb44e219cab78f20d4cd5a7 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/7196d2e12bb44e219cab78f20d4cd5a7 2023-02-16 09:00:33,533 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f2/984610d2ac37432eaeb738858d8bcceb 2023-02-16 09:00:33,534 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/3a75143bd5104a4d8eaf65e0d12a6b2a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,535 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f1/1d3ae9fc93514886818338747e0466bb as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/1d3ae9fc93514886818338747e0466bb 2023-02-16 09:00:33,536 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/.tmp/f2/dc11bc92c6a9471a9161ce00e85877e7 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/dc11bc92c6a9471a9161ce00e85877e7 2023-02-16 09:00:33,544 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f2/0a209d8f6b834ad3a77ae7997b4f43a9 2023-02-16 09:00:33,561 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/7196d2e12bb44e219cab78f20d4cd5a7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,562 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ea6a37f231fca2330be31e8947a0d5b2 in 185ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,563 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:33,563 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,563 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:33,563 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f1/fe26ead23a0a423d9de45441601f722e as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/fe26ead23a0a423d9de45441601f722e 2023-02-16 09:00:33,563 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/1d3ae9fc93514886818338747e0466bb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:33,565 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f1/fb584b114a7d45cb8d7bef59112f0ef2 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/fb584b114a7d45cb8d7bef59112f0ef2 2023-02-16 09:00:33,565 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/.tmp/f2/5852ae092bd24302b41dfaeda2677ec4 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/5852ae092bd24302b41dfaeda2677ec4 2023-02-16 09:00:33,571 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/fb584b114a7d45cb8d7bef59112f0ef2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,572 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f1/e4e0e00d24af4b8cb9d026684fe2ccf4 2023-02-16 09:00:33,573 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/.tmp/f2/984610d2ac37432eaeb738858d8bcceb as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/984610d2ac37432eaeb738858d8bcceb 2023-02-16 09:00:33,576 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/5852ae092bd24302b41dfaeda2677ec4, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:33,576 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/fe26ead23a0a423d9de45441601f722e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:33,577 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 268089b36db308b8035c6069cf6655e3 in 201ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,577 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/dc11bc92c6a9471a9161ce00e85877e7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,577 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:33,577 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,577 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:33,577 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/.tmp/f2/0a209d8f6b834ad3a77ae7997b4f43a9 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/0a209d8f6b834ad3a77ae7997b4f43a9 2023-02-16 09:00:33,578 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c6ed804f13f0e847795cb68a5ca8ad28 in 201ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,578 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:33,578 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:33,578 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:33,578 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. started... 2023-02-16 09:00:33,578 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1eefa54cccb21e4e6766986a3cda1ea0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:33,581 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/984610d2ac37432eaeb738858d8bcceb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,582 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3bb702eba62460bba07cfcfd8a0889ad in 206ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,582 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:33,582 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:33,588 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/0a209d8f6b834ad3a77ae7997b4f43a9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:33,589 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3230af7caffd6ff274867da6cd052a22 in 222ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,590 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:33,590 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,590 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:33,604 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f2/e2abf6baa67f40fda631058b725a9394 2023-02-16 09:00:33,610 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f1/e4e0e00d24af4b8cb9d026684fe2ccf4 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/e4e0e00d24af4b8cb9d026684fe2ccf4 2023-02-16 09:00:33,617 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/e4e0e00d24af4b8cb9d026684fe2ccf4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,618 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f1/03ed8535278c436aa603572d7f8621aa 2023-02-16 09:00:33,619 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/.tmp/f2/e2abf6baa67f40fda631058b725a9394 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/e2abf6baa67f40fda631058b725a9394 2023-02-16 09:00:33,626 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/e2abf6baa67f40fda631058b725a9394, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,627 INFO [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5085b12a4be94eb9e45954aaf4dba946 in 113ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,627 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:33,627 DEBUG [rs(jenkins-hbase4.apache.org,45341,1676538029672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:33,627 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:33,627 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:33,627 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,627 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:00:33,627 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45341,1676538029672' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:00:33,630 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,630 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:33,631 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:33,631 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:33,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45341,1676538029672' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 09:00:33,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71540e85[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:33,646 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f2/8f2f9cc567b8409e9e7d6906db2624cb 2023-02-16 09:00:33,652 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f1/03ed8535278c436aa603572d7f8621aa as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/03ed8535278c436aa603572d7f8621aa 2023-02-16 09:00:33,657 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/03ed8535278c436aa603572d7f8621aa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,658 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/.tmp/f2/8f2f9cc567b8409e9e7d6906db2624cb as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/8f2f9cc567b8409e9e7d6906db2624cb 2023-02-16 09:00:33,662 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/8f2f9cc567b8409e9e7d6906db2624cb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:33,663 INFO [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1eefa54cccb21e4e6766986a3cda1ea0 in 85ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:33,663 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:33,663 DEBUG [rs(jenkins-hbase4.apache.org,41677,1676538029631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:33,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:33,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:33,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:00:33,663 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41677,1676538029631' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:00:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,665 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:33,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41677,1676538029631' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 09:00:33,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71540e85[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:33,667 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 09:00:33,667 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,668 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,668 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:00:33,668 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:00:33,668 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:00:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:00:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45341,1676538029672' in zk 2023-02-16 09:00:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41677,1676538029631' in zk 2023-02-16 09:00:33,669 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,669 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:33,670 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:00:33,670 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,670 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:33,670 DEBUG [member: 'jenkins-hbase4.apache.org,45341,1676538029672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:00:33,672 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:00:33,672 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:33,672 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:33,672 DEBUG [member: 'jenkins-hbase4.apache.org,41677,1676538029631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:00:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45341,1676538029672': 2023-02-16 09:00:33,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45341,1676538029672' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 09:00:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41677,1676538029631': 2023-02-16 09:00:33,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41677,1676538029631' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 09:00:33,680 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 09:00:33,680 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:33,680 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:33,680 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 09:00:33,680 INFO [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:33,681 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,681 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:33,681 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,681 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,682 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,682 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:33,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,683 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:33,685 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:00:33,686 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,688 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:33,688 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:33,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:33,688 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,689 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,689 DEBUG [(jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:33,688 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:33,688 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:33,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:33,690 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:33,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 09:00:33,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:33,689 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:00:33,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:33,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:33,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:33,691 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:33,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:33,791 DEBUG [Listener at localhost/33217] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:33,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45373] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:33,793 INFO [Listener at localhost/33217] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:33,793 DEBUG [Listener at localhost/33217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f797d2c to 127.0.0.1:64894 2023-02-16 09:00:33,794 DEBUG [Listener at localhost/33217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:33,794 DEBUG [Listener at localhost/33217] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:33,794 DEBUG [Listener at localhost/33217] util.JVMClusterUtil(257): Found active master hash=1265194028, stopped=false 2023-02-16 09:00:33,794 INFO [Listener at localhost/33217] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:33,796 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:33,796 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:33,796 INFO [Listener at localhost/33217] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:33,796 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:33,796 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:33,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:33,798 DEBUG [Listener at localhost/33217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7747b684 to 127.0.0.1:64894 2023-02-16 09:00:33,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:33,799 DEBUG [Listener at localhost/33217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:33,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:33,799 INFO [Listener at localhost/33217] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41677,1676538029631' ***** 2023-02-16 09:00:33,799 INFO [Listener at localhost/33217] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:33,799 INFO [Listener at localhost/33217] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45341,1676538029672' ***** 2023-02-16 09:00:33,799 INFO [Listener at localhost/33217] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:33,799 INFO [RS:0;jenkins-hbase4:41677] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:33,799 INFO [RS:1;jenkins-hbase4:45341] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:33,800 INFO [RS:0;jenkins-hbase4:41677] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:33,800 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:33,800 INFO [RS:0;jenkins-hbase4:41677] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:33,800 INFO [RS:1;jenkins-hbase4:45341] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:33,801 INFO [RS:1;jenkins-hbase4:45341] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:33,801 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:33,801 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 648f95868ccbb65f1e29cdb882aeace4 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:33,802 DEBUG [RS:1;jenkins-hbase4:45341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2038a2 to 127.0.0.1:64894 2023-02-16 09:00:33,802 DEBUG [RS:1;jenkins-hbase4:45341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:33,802 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:33,801 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:33,803 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-16 09:00:33,803 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1479): Online Regions={ea6a37f231fca2330be31e8947a0d5b2=testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2., 648f95868ccbb65f1e29cdb882aeace4=hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4., 268089b36db308b8035c6069cf6655e3=testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3., 1588230740=hbase:meta,,1.1588230740, 689cdeb8e05f838a3457945dd2afd8b5=testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5., 7d0a8ee0f981e80c3f5a154713317937=testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937., 5085b12a4be94eb9e45954aaf4dba946=testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.} 2023-02-16 09:00:33,803 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1505): Waiting on 1588230740, 268089b36db308b8035c6069cf6655e3, 5085b12a4be94eb9e45954aaf4dba946, 648f95868ccbb65f1e29cdb882aeace4, 689cdeb8e05f838a3457945dd2afd8b5, 7d0a8ee0f981e80c3f5a154713317937, ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:33,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ea6a37f231fca2330be31e8947a0d5b2, disabling compactions & flushes 2023-02-16 09:00:33,802 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(3304): Received CLOSE for 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:33,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:33,804 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(3304): Received CLOSE for 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. after waiting 0 ms 2023-02-16 09:00:33,804 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(3304): Received CLOSE for aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3230af7caffd6ff274867da6cd052a22, disabling compactions & flushes 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:33,804 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(3304): Received CLOSE for c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,804 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(3304): Received CLOSE for 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:33,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:33,805 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:33,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,805 DEBUG [RS:0;jenkins-hbase4:41677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7963e932 to 127.0.0.1:64894 2023-02-16 09:00:33,805 DEBUG [RS:0;jenkins-hbase4:41677] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:33,805 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-16 09:00:33,805 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1479): Online Regions={3230af7caffd6ff274867da6cd052a22=testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22., 3bb702eba62460bba07cfcfd8a0889ad=testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad., aa546f444ea61682a17b9b727d0899d6=testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6., c6ed804f13f0e847795cb68a5ca8ad28=testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28., 1eefa54cccb21e4e6766986a3cda1ea0=testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.} 2023-02-16 09:00:33,805 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1505): Waiting on 1eefa54cccb21e4e6766986a3cda1ea0, 3230af7caffd6ff274867da6cd052a22, 3bb702eba62460bba07cfcfd8a0889ad, aa546f444ea61682a17b9b727d0899d6, c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:33,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-16 09:00:33,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. after waiting 0 ms 2023-02-16 09:00:33,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,835 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:33,835 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:33,844 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/.tmp/info/c24076ca3e5141dea44775b93feb8610 2023-02-16 09:00:33,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:33,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:33,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3bb702eba62460bba07cfcfd8a0889ad, disabling compactions & flushes 2023-02-16 09:00:33,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. after waiting 0 ms 2023-02-16 09:00:33,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:33,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:33,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 648f95868ccbb65f1e29cdb882aeace4, disabling compactions & flushes 2023-02-16 09:00:33,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:33,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:33,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. after waiting 0 ms 2023-02-16 09:00:33,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:33,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 648f95868ccbb65f1e29cdb882aeace4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:33,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/.tmp/table/eaa348ebfb244f39991fe596764a5cbc 2023-02-16 09:00:33,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:33,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/.tmp/info/c24076ca3e5141dea44775b93feb8610 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/info/c24076ca3e5141dea44775b93feb8610 2023-02-16 09:00:33,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/info/c24076ca3e5141dea44775b93feb8610, entries=110, sequenceid=32, filesize=18.7 K 2023-02-16 09:00:33,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/.tmp/table/eaa348ebfb244f39991fe596764a5cbc as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/table/eaa348ebfb244f39991fe596764a5cbc 2023-02-16 09:00:33,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa546f444ea61682a17b9b727d0899d6, disabling compactions & flushes 2023-02-16 09:00:33,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. after waiting 0 ms 2023-02-16 09:00:33,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/.tmp/info/db53a13e986e4a13b88ecdfc7644e010 2023-02-16 09:00:33,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/table/eaa348ebfb244f39991fe596764a5cbc, entries=4, sequenceid=32, filesize=4.8 K 2023-02-16 09:00:33,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/.tmp/info/db53a13e986e4a13b88ecdfc7644e010 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/info/db53a13e986e4a13b88ecdfc7644e010 2023-02-16 09:00:33,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/info/db53a13e986e4a13b88ecdfc7644e010, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:33,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 648f95868ccbb65f1e29cdb882aeace4 in 86ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:33,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 09:00:33,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 149ms, sequenceid=32, compaction requested=false 2023-02-16 09:00:33,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 09:00:33,967 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 09:00:33,967 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 09:00:33,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:33,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/namespace/648f95868ccbb65f1e29cdb882aeace4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:33,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 648f95868ccbb65f1e29cdb882aeace4: 2023-02-16 09:00:33,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:33,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538030284.648f95868ccbb65f1e29cdb882aeace4. 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c6ed804f13f0e847795cb68a5ca8ad28, disabling compactions & flushes 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 268089b36db308b8035c6069cf6655e3, disabling compactions & flushes 2023-02-16 09:00:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. after waiting 0 ms 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:33,983 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 09:00:33,983 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 09:00:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. after waiting 0 ms 2023-02-16 09:00:33,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:33,998 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-16 09:00:33,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:34,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:34,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:34,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:34,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:34,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 689cdeb8e05f838a3457945dd2afd8b5, disabling compactions & flushes 2023-02-16 09:00:34,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. after waiting 0 ms 2023-02-16 09:00:34,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,005 DEBUG [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1505): Waiting on 5085b12a4be94eb9e45954aaf4dba946, 689cdeb8e05f838a3457945dd2afd8b5, 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:34,005 DEBUG [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1505): Waiting on 1eefa54cccb21e4e6766986a3cda1ea0, c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1eefa54cccb21e4e6766986a3cda1ea0, disabling compactions & flushes 2023-02-16 09:00:34,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. after waiting 0 ms 2023-02-16 09:00:34,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:34,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7d0a8ee0f981e80c3f5a154713317937, disabling compactions & flushes 2023-02-16 09:00:34,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. after waiting 0 ms 2023-02-16 09:00:34,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:34,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:34,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:34,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:34,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5085b12a4be94eb9e45954aaf4dba946, disabling compactions & flushes 2023-02-16 09:00:34,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. after waiting 0 ms 2023-02-16 09:00:34,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:34,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:34,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,205 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45341,1676538029672; all regions closed. 2023-02-16 09:00:34,205 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41677,1676538029631; all regions closed. 2023-02-16 09:00:34,211 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672/jenkins-hbase4.apache.org%2C45341%2C1676538029672.meta.1676538030212.meta not finished, retry = 0 2023-02-16 09:00:34,213 DEBUG [RS:0;jenkins-hbase4:41677] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs 2023-02-16 09:00:34,213 INFO [RS:0;jenkins-hbase4:41677] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41677%2C1676538029631:(num 1676538031002) 2023-02-16 09:00:34,213 DEBUG [RS:0;jenkins-hbase4:41677] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:34,213 INFO [RS:0;jenkins-hbase4:41677] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:34,214 INFO [RS:0;jenkins-hbase4:41677] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:34,214 INFO [RS:0;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:34,214 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:34,214 INFO [RS:0;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:34,214 INFO [RS:0;jenkins-hbase4:41677] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:34,215 INFO [RS:0;jenkins-hbase4:41677] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41677 2023-02-16 09:00:34,219 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:34,219 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:34,219 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41677,1676538029631 2023-02-16 09:00:34,219 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:34,219 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f32012c rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,219 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:34,220 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41677,1676538029631] 2023-02-16 09:00:34,220 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41677,1676538029631; numProcessing=1 2023-02-16 09:00:34,223 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41677,1676538029631 already deleted, retry=false 2023-02-16 09:00:34,223 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41677,1676538029631 expired; onlineServers=1 2023-02-16 09:00:34,314 DEBUG [RS:1;jenkins-hbase4:45341] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs 2023-02-16 09:00:34,314 INFO [RS:1;jenkins-hbase4:45341] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45341%2C1676538029672.meta:.meta(num 1676538030212) 2023-02-16 09:00:34,319 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/WALs/jenkins-hbase4.apache.org,45341,1676538029672/jenkins-hbase4.apache.org%2C45341%2C1676538029672.1676538030651 not finished, retry = 0 2023-02-16 09:00:34,321 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,321 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60af0345 rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,321 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:41677-0x1005c5c0f9a0001, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,321 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@183103fa rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,321 INFO [RS:0;jenkins-hbase4:41677] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41677,1676538029631; zookeeper connection closed. 2023-02-16 09:00:34,322 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6da051c0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6da051c0 2023-02-16 09:00:34,422 DEBUG [RS:1;jenkins-hbase4:45341] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/oldWALs 2023-02-16 09:00:34,422 INFO [RS:1;jenkins-hbase4:45341] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45341%2C1676538029672:(num 1676538030651) 2023-02-16 09:00:34,422 DEBUG [RS:1;jenkins-hbase4:45341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:34,422 INFO [RS:1;jenkins-hbase4:45341] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:34,422 INFO [RS:1;jenkins-hbase4:45341] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:34,423 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:34,424 INFO [RS:1;jenkins-hbase4:45341] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45341 2023-02-16 09:00:34,427 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:34,427 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45341,1676538029672 2023-02-16 09:00:34,427 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45341,1676538029672] 2023-02-16 09:00:34,427 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45341,1676538029672; numProcessing=2 2023-02-16 09:00:34,429 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45341,1676538029672 already deleted, retry=false 2023-02-16 09:00:34,429 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45341,1676538029672 expired; onlineServers=0 2023-02-16 09:00:34,429 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45373,1676538029555' ***** 2023-02-16 09:00:34,429 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:34,431 DEBUG [M:0;jenkins-hbase4:45373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a545e17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:34,431 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45373,1676538029555 2023-02-16 09:00:34,431 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45373,1676538029555; all regions closed. 2023-02-16 09:00:34,431 DEBUG [M:0;jenkins-hbase4:45373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:34,431 DEBUG [M:0;jenkins-hbase4:45373] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:34,431 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:34,431 DEBUG [M:0;jenkins-hbase4:45373] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:34,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538029845] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538029845,5,FailOnTimeoutGroup] 2023-02-16 09:00:34,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538029845] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538029845,5,FailOnTimeoutGroup] 2023-02-16 09:00:34,431 INFO [M:0;jenkins-hbase4:45373] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:34,432 INFO [M:0;jenkins-hbase4:45373] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:34,432 INFO [M:0;jenkins-hbase4:45373] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:34,432 DEBUG [M:0;jenkins-hbase4:45373] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:34,432 INFO [M:0;jenkins-hbase4:45373] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:34,433 ERROR [M:0;jenkins-hbase4:45373] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:00:34,433 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:34,433 INFO [M:0;jenkins-hbase4:45373] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:34,433 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:34,433 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:34,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:34,434 DEBUG [M:0;jenkins-hbase4:45373] zookeeper.ZKUtil(398): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:34,434 WARN [M:0;jenkins-hbase4:45373] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:34,434 INFO [M:0;jenkins-hbase4:45373] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:34,434 INFO [M:0;jenkins-hbase4:45373] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:34,434 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:34,434 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:34,434 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:34,435 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:34,435 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:34,435 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-16 09:00:34,445 WARN [DataStreamer for file /user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/347a403d50974c36bd8d512bcee61bb2] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-16 09:00:34,445 INFO [M:0;jenkins-hbase4:45373] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/347a403d50974c36bd8d512bcee61bb2 2023-02-16 09:00:34,452 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/347a403d50974c36bd8d512bcee61bb2 as hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/347a403d50974c36bd8d512bcee61bb2 2023-02-16 09:00:34,458 INFO [M:0;jenkins-hbase4:45373] regionserver.HStore(1080): Added hdfs://localhost:35125/user/jenkins/test-data/df4b1bf6-afe3-2de2-6b40-31a6f748325b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/347a403d50974c36bd8d512bcee61bb2, entries=31, sequenceid=218, filesize=9.0 K 2023-02-16 09:00:34,459 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=218, compaction requested=false 2023-02-16 09:00:34,460 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:34,460 DEBUG [M:0;jenkins-hbase4:45373] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:34,477 INFO [M:0;jenkins-hbase4:45373] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:34,477 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:34,478 INFO [M:0;jenkins-hbase4:45373] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45373 2023-02-16 09:00:34,485 DEBUG [M:0;jenkins-hbase4:45373] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45373,1676538029555 already deleted, retry=false 2023-02-16 09:00:34,528 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,528 INFO [RS:1;jenkins-hbase4:45341] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45341,1676538029672; zookeeper connection closed. 2023-02-16 09:00:34,528 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b6e2b9a rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,529 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@338e4bf4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@338e4bf4 2023-02-16 09:00:34,529 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): regionserver:45341-0x1005c5c0f9a0002, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,529 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11ba68f rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,529 INFO [Listener at localhost/33217] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:34,629 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,629 INFO [M:0;jenkins-hbase4:45373] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45373,1676538029555; zookeeper connection closed. 2023-02-16 09:00:34,629 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a163ad1 rejected from java.util.concurrent.ThreadPoolExecutor@1e29ad4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,630 DEBUG [Listener at localhost/33217-EventThread] zookeeper.ZKWatcher(600): master:45373-0x1005c5c0f9a0000, quorum=127.0.0.1:64894, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:34,630 ERROR [Listener at localhost/33217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4151d5aa rejected from java.util.concurrent.ThreadPoolExecutor@1e29ad4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:34,732 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop-3485490433536649847.jar 2023-02-16 09:00:34,736 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676538031729 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:34,736 DEBUG [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:34,737 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(239): region to add: 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=ea6a37f231fca2330be31e8947a0d5b2 as ea6a37f231fca2330be31e8947a0d5b2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=3230af7caffd6ff274867da6cd052a22 as 3230af7caffd6ff274867da6cd052a22 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=268089b36db308b8035c6069cf6655e3 as 268089b36db308b8035c6069cf6655e3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=3bb702eba62460bba07cfcfd8a0889ad as 3bb702eba62460bba07cfcfd8a0889ad in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=aa546f444ea61682a17b9b727d0899d6 as aa546f444ea61682a17b9b727d0899d6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=c6ed804f13f0e847795cb68a5ca8ad28 as c6ed804f13f0e847795cb68a5ca8ad28 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=689cdeb8e05f838a3457945dd2afd8b5 as 689cdeb8e05f838a3457945dd2afd8b5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=5085b12a4be94eb9e45954aaf4dba946 as 5085b12a4be94eb9e45954aaf4dba946 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=7d0a8ee0f981e80c3f5a154713317937 as 7d0a8ee0f981e80c3f5a154713317937 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,738 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(585): clone region=1eefa54cccb21e4e6766986a3cda1ea0 as 1eefa54cccb21e4e6766986a3cda1ea0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 09:00:34,739 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3230af7caffd6ff274867da6cd052a22, NAME => 'testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,739 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea6a37f231fca2330be31e8947a0d5b2, NAME => 'testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,742 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3bb702eba62460bba07cfcfd8a0889ad, NAME => 'testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,742 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c6ed804f13f0e847795cb68a5ca8ad28, NAME => 'testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,743 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 689cdeb8e05f838a3457945dd2afd8b5, NAME => 'testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,743 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 268089b36db308b8035c6069cf6655e3, NAME => 'testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,743 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => aa546f444ea61682a17b9b727d0899d6, NAME => 'testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,744 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5085b12a4be94eb9e45954aaf4dba946, NAME => 'testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,754 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,754 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34a4bdb8d6944cb88830a879361a8886 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,758 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f11a59914c446f685e1dc39151dfa69 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,761 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9fbb6f906a646c3a029750d0e19934c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3230af7caffd6ff274867da6cd052a22, disabling compactions & flushes 2023-02-16 09:00:34,761 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:34,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:34,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. after waiting 0 ms 2023-02-16 09:00:34,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:34,761 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:34,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:34,762 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7d0a8ee0f981e80c3f5a154713317937, NAME => 'testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,765 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,765 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e7e9d25aaea14ce5909a8249ca6e9ee1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,765 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 12a6d890db024bf8aa793a0567854022 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,767 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b2812df6397a4dfc82adf4410edffbbd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ea6a37f231fca2330be31e8947a0d5b2, disabling compactions & flushes 2023-02-16 09:00:34,768 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:34,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:34,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. after waiting 0 ms 2023-02-16 09:00:34,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:34,768 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:34,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:34,769 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1eefa54cccb21e4e6766986a3cda1ea0, NAME => 'testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,769 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,769 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3703fe279f1f4a14a27b90985ec63019 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,771 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,771 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,771 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ceb6267684964e8f86fa9b7fdf0c010c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing aa546f444ea61682a17b9b727d0899d6, disabling compactions & flushes 2023-02-16 09:00:34,772 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:34,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:34,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. after waiting 0 ms 2023-02-16 09:00:34,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:34,772 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:34,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:34,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 689cdeb8e05f838a3457945dd2afd8b5, disabling compactions & flushes 2023-02-16 09:00:34,773 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. after waiting 0 ms 2023-02-16 09:00:34,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,773 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:34,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:34,775 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,775 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,775 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6f8036993054427c8fb2f668f8bc129d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,775 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6b0068a7b0c049c9a24bb58dde61fa2e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,775 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink efae9a1e76e447948d586ee5ee82ed51 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,775 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cf82b5f85d1641268ecdcd14774a05e6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,780 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd65201ac8a1461194f159ae092e326d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,781 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c8309fffa9743c3b44300ac57df35be from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5085b12a4be94eb9e45954aaf4dba946, disabling compactions & flushes 2023-02-16 09:00:34,782 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. after waiting 0 ms 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,782 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3bb702eba62460bba07cfcfd8a0889ad, disabling compactions & flushes 2023-02-16 09:00:34,782 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. after waiting 0 ms 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:34,782 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:34,782 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:34,783 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c6ed804f13f0e847795cb68a5ca8ad28, disabling compactions & flushes 2023-02-16 09:00:34,783 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,783 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,783 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. after waiting 0 ms 2023-02-16 09:00:34,783 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,783 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:34,783 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 268089b36db308b8035c6069cf6655e3, disabling compactions & flushes 2023-02-16 09:00:34,790 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. after waiting 0 ms 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7d0a8ee0f981e80c3f5a154713317937, disabling compactions & flushes 2023-02-16 09:00:34,790 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:34,790 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. after waiting 0 ms 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,790 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:34,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:34,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:34,792 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5db082e7d47544589690eead063cb390 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,794 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d7a4b02983247c2b65a433af0994dc3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 09:00:34,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1eefa54cccb21e4e6766986a3cda1ea0, disabling compactions & flushes 2023-02-16 09:00:34,796 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. after waiting 0 ms 2023-02-16 09:00:34,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,796 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:34,796 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:34,796 INFO [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676538031729 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:34,796 DEBUG [Listener at localhost/33217] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,796 DEBUG [Listener at localhost/33217] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6 2023-02-16 09:00:34,797 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:34,797 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:34,798 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 09:00:34,798 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------1eefa54cccb21e4e6766986a3cda1ea0/ 2023-02-16 09:00:34,798 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,799 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,799 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=1eefa54cccb21e4e6766986a3cda1ea0-5db082e7d47544589690eead063cb390 2023-02-16 09:00:34,799 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,799 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=1eefa54cccb21e4e6766986a3cda1ea0-5d7a4b02983247c2b65a433af0994dc3 2023-02-16 09:00:34,799 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------268089b36db308b8035c6069cf6655e3/ 2023-02-16 09:00:34,800 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,800 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,800 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=268089b36db308b8035c6069cf6655e3-6b0068a7b0c049c9a24bb58dde61fa2e 2023-02-16 09:00:34,800 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,801 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=268089b36db308b8035c6069cf6655e3-4c8309fffa9743c3b44300ac57df35be 2023-02-16 09:00:34,801 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------3230af7caffd6ff274867da6cd052a22/ 2023-02-16 09:00:34,801 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,801 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,802 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=3230af7caffd6ff274867da6cd052a22-34a4bdb8d6944cb88830a879361a8886 2023-02-16 09:00:34,802 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,802 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=3230af7caffd6ff274867da6cd052a22-4f11a59914c446f685e1dc39151dfa69 2023-02-16 09:00:34,802 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------3bb702eba62460bba07cfcfd8a0889ad/ 2023-02-16 09:00:34,803 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,803 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,803 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=3bb702eba62460bba07cfcfd8a0889ad-6f8036993054427c8fb2f668f8bc129d 2023-02-16 09:00:34,803 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,804 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=3bb702eba62460bba07cfcfd8a0889ad-dd65201ac8a1461194f159ae092e326d 2023-02-16 09:00:34,804 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------5085b12a4be94eb9e45954aaf4dba946/ 2023-02-16 09:00:34,804 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,804 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,805 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=5085b12a4be94eb9e45954aaf4dba946-ceb6267684964e8f86fa9b7fdf0c010c 2023-02-16 09:00:34,805 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,805 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=5085b12a4be94eb9e45954aaf4dba946-cf82b5f85d1641268ecdcd14774a05e6 2023-02-16 09:00:34,805 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------689cdeb8e05f838a3457945dd2afd8b5/ 2023-02-16 09:00:34,806 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,806 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,806 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=689cdeb8e05f838a3457945dd2afd8b5-e7e9d25aaea14ce5909a8249ca6e9ee1 2023-02-16 09:00:34,806 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,807 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=689cdeb8e05f838a3457945dd2afd8b5-b2812df6397a4dfc82adf4410edffbbd 2023-02-16 09:00:34,807 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------7d0a8ee0f981e80c3f5a154713317937/ 2023-02-16 09:00:34,807 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,807 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------aa546f444ea61682a17b9b727d0899d6/ 2023-02-16 09:00:34,811 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,811 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------c6ed804f13f0e847795cb68a5ca8ad28/ 2023-02-16 09:00:34,811 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,812 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,812 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=c6ed804f13f0e847795cb68a5ca8ad28-3703fe279f1f4a14a27b90985ec63019 2023-02-16 09:00:34,812 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,813 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=c6ed804f13f0e847795cb68a5ca8ad28-efae9a1e76e447948d586ee5ee82ed51 2023-02-16 09:00:34,813 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |----------ea6a37f231fca2330be31e8947a0d5b2/ 2023-02-16 09:00:34,813 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:34,814 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:34,814 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=ea6a37f231fca2330be31e8947a0d5b2-c9fbb6f906a646c3a029750d0e19934c 2023-02-16 09:00:34,814 DEBUG [Listener at localhost/33217] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:34,815 DEBUG [Listener at localhost/33217] util.CommonFSUtils(702): |----------------testWithMapReduce=ea6a37f231fca2330be31e8947a0d5b2-12a6d890db024bf8aa793a0567854022 2023-02-16 09:00:34,815 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:34,816 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:34,816 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:34,816 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,764 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop-3116285259984309424.jar 2023-02-16 09:00:35,765 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,766 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,844 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop-5853056398619979323.jar 2023-02-16 09:00:35,844 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,845 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,846 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,846 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,847 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,847 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,848 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 09:00:35,848 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 09:00:35,848 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 09:00:35,849 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 09:00:35,849 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 09:00:35,850 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 09:00:35,850 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 09:00:35,850 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 09:00:35,851 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 09:00:35,851 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 09:00:35,852 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:00:35,852 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:35,852 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:35,853 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:00:35,853 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:00:35,931 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop-8117891147786603737.jar 2023-02-16 09:00:35,931 DEBUG [Listener at localhost/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:00:35,937 WARN [Listener at localhost/33217] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 09:00:35,943 WARN [Listener at localhost/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 09:00:35,951 INFO [Listener at localhost/33217] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 09:00:36,084 WARN [Listener at localhost/33217] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/mapreduce.cluster.local.dir/1676538036028/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 09:00:36,084 WARN [Listener at localhost/33217] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/mapreduce.cluster.local.dir/1676538036028/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 09:00:36,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,146 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,152 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,157 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:36,158 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1 2023-02-16 09:00:36,159 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 268089b36db308b8035c6069cf6655e3 columnFamilyName f1 2023-02-16 09:00:36,169 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f1/testWithMapReduce=268089b36db308b8035c6069cf6655e3-6b0068a7b0c049c9a24bb58dde61fa2e 2023-02-16 09:00:36,169 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(310): Store=268089b36db308b8035c6069cf6655e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,169 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 268089b36db308b8035c6069cf6655e3 2023-02-16 09:00:36,171 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2 2023-02-16 09:00:36,171 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 268089b36db308b8035c6069cf6655e3 columnFamilyName f2 2023-02-16 09:00:36,177 DEBUG [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/268089b36db308b8035c6069cf6655e3/f2/testWithMapReduce=268089b36db308b8035c6069cf6655e3-4c8309fffa9743c3b44300ac57df35be 2023-02-16 09:00:36,178 INFO [StoreOpener-268089b36db308b8035c6069cf6655e3-1] regionserver.HStore(310): Store=268089b36db308b8035c6069cf6655e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,178 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,178 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 268089b36db308b8035c6069cf6655e3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71484741, jitterRate=0.0652056485414505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,178 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:36,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 268089b36db308b8035c6069cf6655e3, disabling compactions & flushes 2023-02-16 09:00:36,221 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:36,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:36,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. after waiting 0 ms 2023-02-16 09:00:36,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:36,223 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676538030953.268089b36db308b8035c6069cf6655e3. 2023-02-16 09:00:36,223 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 268089b36db308b8035c6069cf6655e3: 2023-02-16 09:00:36,227 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,227 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,229 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,232 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:36,234 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1 2023-02-16 09:00:36,234 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eefa54cccb21e4e6766986a3cda1ea0 columnFamilyName f1 2023-02-16 09:00:36,240 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f1/testWithMapReduce=1eefa54cccb21e4e6766986a3cda1ea0-5db082e7d47544589690eead063cb390 2023-02-16 09:00:36,240 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(310): Store=1eefa54cccb21e4e6766986a3cda1ea0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,240 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1eefa54cccb21e4e6766986a3cda1ea0 2023-02-16 09:00:36,241 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2 2023-02-16 09:00:36,241 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eefa54cccb21e4e6766986a3cda1ea0 columnFamilyName f2 2023-02-16 09:00:36,246 DEBUG [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/1eefa54cccb21e4e6766986a3cda1ea0/f2/testWithMapReduce=1eefa54cccb21e4e6766986a3cda1ea0-5d7a4b02983247c2b65a433af0994dc3 2023-02-16 09:00:36,246 INFO [StoreOpener-1eefa54cccb21e4e6766986a3cda1ea0-1] regionserver.HStore(310): Store=1eefa54cccb21e4e6766986a3cda1ea0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1eefa54cccb21e4e6766986a3cda1ea0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70265084, jitterRate=0.04703134298324585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:36,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1eefa54cccb21e4e6766986a3cda1ea0, disabling compactions & flushes 2023-02-16 09:00:36,280 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:36,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:36,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. after waiting 0 ms 2023-02-16 09:00:36,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:36,281 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676538030953.1eefa54cccb21e4e6766986a3cda1ea0. 2023-02-16 09:00:36,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1eefa54cccb21e4e6766986a3cda1ea0: 2023-02-16 09:00:36,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,285 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,287 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,288 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:36,289 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1 2023-02-16 09:00:36,290 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3230af7caffd6ff274867da6cd052a22 columnFamilyName f1 2023-02-16 09:00:36,296 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f1/testWithMapReduce=3230af7caffd6ff274867da6cd052a22-34a4bdb8d6944cb88830a879361a8886 2023-02-16 09:00:36,296 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(310): Store=3230af7caffd6ff274867da6cd052a22/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,296 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3230af7caffd6ff274867da6cd052a22 2023-02-16 09:00:36,298 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2 2023-02-16 09:00:36,299 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3230af7caffd6ff274867da6cd052a22 columnFamilyName f2 2023-02-16 09:00:36,304 DEBUG [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3230af7caffd6ff274867da6cd052a22/f2/testWithMapReduce=3230af7caffd6ff274867da6cd052a22-4f11a59914c446f685e1dc39151dfa69 2023-02-16 09:00:36,304 INFO [StoreOpener-3230af7caffd6ff274867da6cd052a22-1] regionserver.HStore(310): Store=3230af7caffd6ff274867da6cd052a22/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,305 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,305 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3230af7caffd6ff274867da6cd052a22; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64187412, jitterRate=-0.04353302717208862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,305 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:36,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3230af7caffd6ff274867da6cd052a22, disabling compactions & flushes 2023-02-16 09:00:36,340 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:36,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:36,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. after waiting 0 ms 2023-02-16 09:00:36,341 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:36,353 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676538030953.3230af7caffd6ff274867da6cd052a22. 2023-02-16 09:00:36,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3230af7caffd6ff274867da6cd052a22: 2023-02-16 09:00:36,358 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,358 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,362 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,365 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:36,366 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1 2023-02-16 09:00:36,367 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb702eba62460bba07cfcfd8a0889ad columnFamilyName f1 2023-02-16 09:00:36,374 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f1/testWithMapReduce=3bb702eba62460bba07cfcfd8a0889ad-6f8036993054427c8fb2f668f8bc129d 2023-02-16 09:00:36,375 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(310): Store=3bb702eba62460bba07cfcfd8a0889ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,375 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bb702eba62460bba07cfcfd8a0889ad 2023-02-16 09:00:36,376 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2 2023-02-16 09:00:36,376 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb702eba62460bba07cfcfd8a0889ad columnFamilyName f2 2023-02-16 09:00:36,381 DEBUG [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/3bb702eba62460bba07cfcfd8a0889ad/f2/testWithMapReduce=3bb702eba62460bba07cfcfd8a0889ad-dd65201ac8a1461194f159ae092e326d 2023-02-16 09:00:36,381 INFO [StoreOpener-3bb702eba62460bba07cfcfd8a0889ad-1] regionserver.HStore(310): Store=3bb702eba62460bba07cfcfd8a0889ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,381 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,381 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3bb702eba62460bba07cfcfd8a0889ad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66088769, jitterRate=-0.015200600028038025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,381 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:36,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3bb702eba62460bba07cfcfd8a0889ad, disabling compactions & flushes 2023-02-16 09:00:36,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:36,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:36,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. after waiting 0 ms 2023-02-16 09:00:36,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:36,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676538030953.3bb702eba62460bba07cfcfd8a0889ad. 2023-02-16 09:00:36,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3bb702eba62460bba07cfcfd8a0889ad: 2023-02-16 09:00:36,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,435 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,436 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,438 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:36,439 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1 2023-02-16 09:00:36,439 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5085b12a4be94eb9e45954aaf4dba946 columnFamilyName f1 2023-02-16 09:00:36,444 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f1/testWithMapReduce=5085b12a4be94eb9e45954aaf4dba946-ceb6267684964e8f86fa9b7fdf0c010c 2023-02-16 09:00:36,444 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(310): Store=5085b12a4be94eb9e45954aaf4dba946/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,444 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5085b12a4be94eb9e45954aaf4dba946 2023-02-16 09:00:36,445 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2 2023-02-16 09:00:36,445 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5085b12a4be94eb9e45954aaf4dba946 columnFamilyName f2 2023-02-16 09:00:36,450 DEBUG [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/5085b12a4be94eb9e45954aaf4dba946/f2/testWithMapReduce=5085b12a4be94eb9e45954aaf4dba946-cf82b5f85d1641268ecdcd14774a05e6 2023-02-16 09:00:36,450 INFO [StoreOpener-5085b12a4be94eb9e45954aaf4dba946-1] regionserver.HStore(310): Store=5085b12a4be94eb9e45954aaf4dba946/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,450 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5085b12a4be94eb9e45954aaf4dba946; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71651297, jitterRate=0.06768752634525299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:36,483 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5085b12a4be94eb9e45954aaf4dba946, disabling compactions & flushes 2023-02-16 09:00:36,484 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:36,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:36,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. after waiting 0 ms 2023-02-16 09:00:36,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:36,485 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676538030953.5085b12a4be94eb9e45954aaf4dba946. 2023-02-16 09:00:36,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5085b12a4be94eb9e45954aaf4dba946: 2023-02-16 09:00:36,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,489 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,491 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,496 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:36,497 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1 2023-02-16 09:00:36,498 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 689cdeb8e05f838a3457945dd2afd8b5 columnFamilyName f1 2023-02-16 09:00:36,503 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f1/testWithMapReduce=689cdeb8e05f838a3457945dd2afd8b5-e7e9d25aaea14ce5909a8249ca6e9ee1 2023-02-16 09:00:36,503 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(310): Store=689cdeb8e05f838a3457945dd2afd8b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,503 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 689cdeb8e05f838a3457945dd2afd8b5 2023-02-16 09:00:36,504 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2 2023-02-16 09:00:36,504 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 689cdeb8e05f838a3457945dd2afd8b5 columnFamilyName f2 2023-02-16 09:00:36,509 DEBUG [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/689cdeb8e05f838a3457945dd2afd8b5/f2/testWithMapReduce=689cdeb8e05f838a3457945dd2afd8b5-b2812df6397a4dfc82adf4410edffbbd 2023-02-16 09:00:36,509 INFO [StoreOpener-689cdeb8e05f838a3457945dd2afd8b5-1] regionserver.HStore(310): Store=689cdeb8e05f838a3457945dd2afd8b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,509 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 689cdeb8e05f838a3457945dd2afd8b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66350611, jitterRate=-0.011298850178718567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:36,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 689cdeb8e05f838a3457945dd2afd8b5, disabling compactions & flushes 2023-02-16 09:00:36,538 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:36,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:36,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. after waiting 0 ms 2023-02-16 09:00:36,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:36,539 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676538030953.689cdeb8e05f838a3457945dd2afd8b5. 2023-02-16 09:00:36,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 689cdeb8e05f838a3457945dd2afd8b5: 2023-02-16 09:00:36,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,542 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,543 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,545 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:36,546 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1 2023-02-16 09:00:36,546 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6ed804f13f0e847795cb68a5ca8ad28 columnFamilyName f1 2023-02-16 09:00:36,550 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f1/testWithMapReduce=c6ed804f13f0e847795cb68a5ca8ad28-3703fe279f1f4a14a27b90985ec63019 2023-02-16 09:00:36,550 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(310): Store=c6ed804f13f0e847795cb68a5ca8ad28/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,551 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c6ed804f13f0e847795cb68a5ca8ad28 2023-02-16 09:00:36,551 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2 2023-02-16 09:00:36,552 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6ed804f13f0e847795cb68a5ca8ad28 columnFamilyName f2 2023-02-16 09:00:36,556 DEBUG [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/c6ed804f13f0e847795cb68a5ca8ad28/f2/testWithMapReduce=c6ed804f13f0e847795cb68a5ca8ad28-efae9a1e76e447948d586ee5ee82ed51 2023-02-16 09:00:36,556 INFO [StoreOpener-c6ed804f13f0e847795cb68a5ca8ad28-1] regionserver.HStore(310): Store=c6ed804f13f0e847795cb68a5ca8ad28/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,556 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c6ed804f13f0e847795cb68a5ca8ad28; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69695943, jitterRate=0.0385504812002182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:36,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c6ed804f13f0e847795cb68a5ca8ad28, disabling compactions & flushes 2023-02-16 09:00:36,590 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:36,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:36,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. after waiting 0 ms 2023-02-16 09:00:36,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:36,591 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676538030953.c6ed804f13f0e847795cb68a5ca8ad28. 2023-02-16 09:00:36,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c6ed804f13f0e847795cb68a5ca8ad28: 2023-02-16 09:00:36,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,595 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,596 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,599 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:36,600 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1 2023-02-16 09:00:36,601 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea6a37f231fca2330be31e8947a0d5b2 columnFamilyName f1 2023-02-16 09:00:36,606 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f1/testWithMapReduce=ea6a37f231fca2330be31e8947a0d5b2-c9fbb6f906a646c3a029750d0e19934c 2023-02-16 09:00:36,607 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(310): Store=ea6a37f231fca2330be31e8947a0d5b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,607 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea6a37f231fca2330be31e8947a0d5b2 2023-02-16 09:00:36,608 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2 2023-02-16 09:00:36,608 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea6a37f231fca2330be31e8947a0d5b2 columnFamilyName f2 2023-02-16 09:00:36,613 DEBUG [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(539): loaded hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/ea6a37f231fca2330be31e8947a0d5b2/f2/testWithMapReduce=ea6a37f231fca2330be31e8947a0d5b2-12a6d890db024bf8aa793a0567854022 2023-02-16 09:00:36,613 INFO [StoreOpener-ea6a37f231fca2330be31e8947a0d5b2-1] regionserver.HStore(310): Store=ea6a37f231fca2330be31e8947a0d5b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,614 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ea6a37f231fca2330be31e8947a0d5b2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60503307, jitterRate=-0.09843046963214874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,614 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:36,650 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ea6a37f231fca2330be31e8947a0d5b2, disabling compactions & flushes 2023-02-16 09:00:36,650 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:36,651 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:36,651 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. after waiting 0 ms 2023-02-16 09:00:36,651 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:36,652 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676538030953.ea6a37f231fca2330be31e8947a0d5b2. 2023-02-16 09:00:36,652 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ea6a37f231fca2330be31e8947a0d5b2: 2023-02-16 09:00:36,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,655 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,660 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,662 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:36,663 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f1 2023-02-16 09:00:36,663 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa546f444ea61682a17b9b727d0899d6 columnFamilyName f1 2023-02-16 09:00:36,664 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(310): Store=aa546f444ea61682a17b9b727d0899d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,664 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa546f444ea61682a17b9b727d0899d6 2023-02-16 09:00:36,665 DEBUG [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/aa546f444ea61682a17b9b727d0899d6/f2 2023-02-16 09:00:36,666 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa546f444ea61682a17b9b727d0899d6 columnFamilyName f2 2023-02-16 09:00:36,666 INFO [StoreOpener-aa546f444ea61682a17b9b727d0899d6-1] regionserver.HStore(310): Store=aa546f444ea61682a17b9b727d0899d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aa546f444ea61682a17b9b727d0899d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69300106, jitterRate=0.032652050256729126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:36,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aa546f444ea61682a17b9b727d0899d6, disabling compactions & flushes 2023-02-16 09:00:36,684 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:36,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:36,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. after waiting 0 ms 2023-02-16 09:00:36,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:36,685 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676538030953.aa546f444ea61682a17b9b727d0899d6. 2023-02-16 09:00:36,685 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aa546f444ea61682a17b9b727d0899d6: 2023-02-16 09:00:36,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:36,688 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:36,689 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:36,695 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:36,696 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f1 2023-02-16 09:00:36,697 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d0a8ee0f981e80c3f5a154713317937 columnFamilyName f1 2023-02-16 09:00:36,697 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(310): Store=7d0a8ee0f981e80c3f5a154713317937/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,698 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d0a8ee0f981e80c3f5a154713317937 2023-02-16 09:00:36,699 DEBUG [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35125/user/jenkins/test-data/7a29599e-b20b-3891-378c-ca398b31e45f/testWithMapReduceAndOfflineHBaseMultiRegion/89ab8114-a503-4500-a4dc-c8bf35f812a6/data/default/testWithMapReduce/7d0a8ee0f981e80c3f5a154713317937/f2 2023-02-16 09:00:36,699 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d0a8ee0f981e80c3f5a154713317937 columnFamilyName f2 2023-02-16 09:00:36,700 INFO [StoreOpener-7d0a8ee0f981e80c3f5a154713317937-1] regionserver.HStore(310): Store=7d0a8ee0f981e80c3f5a154713317937/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:36,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:36,701 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7d0a8ee0f981e80c3f5a154713317937; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62524106, jitterRate=-0.06831821799278259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:36,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:36,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7d0a8ee0f981e80c3f5a154713317937, disabling compactions & flushes 2023-02-16 09:00:36,720 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:36,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:36,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. after waiting 0 ms 2023-02-16 09:00:36,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:36,721 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538030953.7d0a8ee0f981e80c3f5a154713317937. 2023-02-16 09:00:36,721 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7d0a8ee0f981e80c3f5a154713317937: 2023-02-16 09:00:37,141 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:37,142 WARN [Listener at localhost/33217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:37,147 INFO [Listener at localhost/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:37,253 WARN [BP-1315634515-172.31.14.131-1676538028899 heartbeating to localhost/127.0.0.1:35125] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:37,254 WARN [BP-1315634515-172.31.14.131-1676538028899 heartbeating to localhost/127.0.0.1:35125] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1315634515-172.31.14.131-1676538028899 (Datanode Uuid 079d6161-0ed5-4276-ab9b-a69a95f96b22) service to localhost/127.0.0.1:35125 2023-02-16 09:00:37,254 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/dfs/data/data3/current/BP-1315634515-172.31.14.131-1676538028899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:37,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/dfs/data/data4/current/BP-1315634515-172.31.14.131-1676538028899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:37,256 WARN [Listener at localhost/33217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:37,264 INFO [Listener at localhost/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:37,368 WARN [BP-1315634515-172.31.14.131-1676538028899 heartbeating to localhost/127.0.0.1:35125] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:37,368 WARN [BP-1315634515-172.31.14.131-1676538028899 heartbeating to localhost/127.0.0.1:35125] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1315634515-172.31.14.131-1676538028899 (Datanode Uuid 9136d036-9f88-46ac-afa5-4eb5c23adc76) service to localhost/127.0.0.1:35125 2023-02-16 09:00:37,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/dfs/data/data1/current/BP-1315634515-172.31.14.131-1676538028899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:37,369 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/cluster_4b7e6ce8-66fd-a7a4-c105-911ba8b4261e/dfs/data/data2/current/BP-1315634515-172.31.14.131-1676538028899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:37,378 INFO [Listener at localhost/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:37,498 INFO [Listener at localhost/33217] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:00:37,544 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:00:37,558 INFO [Listener at localhost/33217] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 103) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:35125 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:35125 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33217 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:35125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:35125 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,45373,1676538029555)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:35125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:35125 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=546 (was 532) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1785 (was 2285) 2023-02-16 09:00:37,568 INFO [Listener at localhost/33217] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=546, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=169, AvailableMemoryMB=1785 2023-02-16 09:00:37,578 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.log.dir so I do NOT create it in target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00 2023-02-16 09:00:37,578 WARN [Listener at localhost/33217] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:00:37,578 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.tmp.dir so I do NOT create it in target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00 2023-02-16 09:00:37,578 WARN [Listener at localhost/33217] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3fb05a2-e437-c253-bca1-06a31f455808/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:00:37,578 DEBUG [Listener at localhost/33217] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00 2023-02-16 09:00:37,578 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3, deleteOnExit=true 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/test.cache.data in system properties and HBase conf 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:37,579 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:37,579 DEBUG [Listener at localhost/33217] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:37,580 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:37,581 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:37,581 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:37,581 INFO [Listener at localhost/33217] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:37,585 WARN [Listener at localhost/33217] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:37,585 WARN [Listener at localhost/33217] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:37,625 WARN [Listener at localhost/33217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:37,627 INFO [Listener at localhost/33217] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:37,634 INFO [Listener at localhost/33217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/java.io.tmpdir/Jetty_localhost_34135_hdfs____b2v1mk/webapp 2023-02-16 09:00:37,727 INFO [Listener at localhost/33217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34135 2023-02-16 09:00:37,732 WARN [Listener at localhost/33217] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:37,732 WARN [Listener at localhost/33217] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:37,769 WARN [Listener at localhost/41235] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:37,778 WARN [Listener at localhost/41235] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:37,780 WARN [Listener at localhost/41235] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:37,781 INFO [Listener at localhost/41235] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:37,787 INFO [Listener at localhost/41235] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/java.io.tmpdir/Jetty_localhost_38409_datanode____.kqaush/webapp 2023-02-16 09:00:37,892 INFO [Listener at localhost/41235] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38409 2023-02-16 09:00:37,904 WARN [Listener at localhost/45447] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:37,926 WARN [Listener at localhost/45447] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:37,928 WARN [Listener at localhost/45447] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:37,929 INFO [Listener at localhost/45447] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:37,934 INFO [Listener at localhost/45447] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/java.io.tmpdir/Jetty_localhost_41429_datanode____.qzywjf/webapp 2023-02-16 09:00:38,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x566476f2770cfda9: Processing first storage report for DS-4ddbe164-442a-4b19-9c0d-a996e8a32790 from datanode 1d4919c4-9c77-402c-8e4a-cb825030722a 2023-02-16 09:00:38,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x566476f2770cfda9: from storage DS-4ddbe164-442a-4b19-9c0d-a996e8a32790 node DatanodeRegistration(127.0.0.1:40127, datanodeUuid=1d4919c4-9c77-402c-8e4a-cb825030722a, infoPort=33379, infoSecurePort=0, ipcPort=45447, storageInfo=lv=-57;cid=testClusterID;nsid=216878273;c=1676538037588), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:38,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x566476f2770cfda9: Processing first storage report for DS-a4a72c30-56ac-4e05-9b4d-1a310f260b10 from datanode 1d4919c4-9c77-402c-8e4a-cb825030722a 2023-02-16 09:00:38,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x566476f2770cfda9: from storage DS-a4a72c30-56ac-4e05-9b4d-1a310f260b10 node DatanodeRegistration(127.0.0.1:40127, datanodeUuid=1d4919c4-9c77-402c-8e4a-cb825030722a, infoPort=33379, infoSecurePort=0, ipcPort=45447, storageInfo=lv=-57;cid=testClusterID;nsid=216878273;c=1676538037588), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:38,057 INFO [Listener at localhost/45447] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41429 2023-02-16 09:00:38,069 WARN [Listener at localhost/46739] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:38,179 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad3344f7fb50374e: Processing first storage report for DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a from datanode 5b845b75-ea62-4bc2-b872-28c16581433a 2023-02-16 09:00:38,179 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad3344f7fb50374e: from storage DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a node DatanodeRegistration(127.0.0.1:40519, datanodeUuid=5b845b75-ea62-4bc2-b872-28c16581433a, infoPort=33657, infoSecurePort=0, ipcPort=46739, storageInfo=lv=-57;cid=testClusterID;nsid=216878273;c=1676538037588), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:38,179 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad3344f7fb50374e: Processing first storage report for DS-b35ed86e-c3b1-4f12-9c80-a7fee7502ca1 from datanode 5b845b75-ea62-4bc2-b872-28c16581433a 2023-02-16 09:00:38,179 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad3344f7fb50374e: from storage DS-b35ed86e-c3b1-4f12-9c80-a7fee7502ca1 node DatanodeRegistration(127.0.0.1:40519, datanodeUuid=5b845b75-ea62-4bc2-b872-28c16581433a, infoPort=33657, infoSecurePort=0, ipcPort=46739, storageInfo=lv=-57;cid=testClusterID;nsid=216878273;c=1676538037588), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:38,209 DEBUG [Listener at localhost/46739] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00 2023-02-16 09:00:38,211 INFO [Listener at localhost/46739] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/zookeeper_0, clientPort=57287, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:38,216 INFO [Listener at localhost/46739] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57287 2023-02-16 09:00:38,216 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,217 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,232 INFO [Listener at localhost/46739] util.FSUtils(479): Created version file at hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627 with version=8 2023-02-16 09:00:38,233 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,234 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,235 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41235/user/jenkins/test-data/7790f088-cc9f-e3a1-077b-db0ce345ce66/hbase-staging 2023-02-16 09:00:38,237 INFO [Listener at localhost/46739] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:38,237 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,237 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,237 INFO [Listener at localhost/46739] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:38,238 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,238 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:38,238 INFO [Listener at localhost/46739] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:38,239 INFO [Listener at localhost/46739] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37727 2023-02-16 09:00:38,240 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,241 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,242 INFO [Listener at localhost/46739] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37727 connecting to ZooKeeper ensemble=127.0.0.1:57287 2023-02-16 09:00:38,252 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:377270x0, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:38,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37727-0x1005c5c31880000 connected 2023-02-16 09:00:38,279 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:38,280 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:38,280 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:38,281 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-16 09:00:38,281 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37727 2023-02-16 09:00:38,282 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37727 2023-02-16 09:00:38,282 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-16 09:00:38,283 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-16 09:00:38,283 INFO [Listener at localhost/46739] master.HMaster(444): hbase.rootdir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627, hbase.cluster.distributed=false 2023-02-16 09:00:38,299 INFO [Listener at localhost/46739] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:38,299 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,299 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,300 INFO [Listener at localhost/46739] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:38,300 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,300 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:38,300 INFO [Listener at localhost/46739] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:38,306 INFO [Listener at localhost/46739] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35351 2023-02-16 09:00:38,307 INFO [Listener at localhost/46739] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:38,310 DEBUG [Listener at localhost/46739] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:38,310 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,311 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,312 INFO [Listener at localhost/46739] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35351 connecting to ZooKeeper ensemble=127.0.0.1:57287 2023-02-16 09:00:38,315 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:353510x0, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:38,316 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:353510x0, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:38,316 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:353510x0, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:38,317 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:353510x0, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:38,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35351-0x1005c5c31880001 connected 2023-02-16 09:00:38,321 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35351 2023-02-16 09:00:38,321 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35351 2023-02-16 09:00:38,321 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35351 2023-02-16 09:00:38,321 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35351 2023-02-16 09:00:38,322 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35351 2023-02-16 09:00:38,334 INFO [Listener at localhost/46739] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:38,334 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,334 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,334 INFO [Listener at localhost/46739] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:38,335 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:38,335 INFO [Listener at localhost/46739] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:38,335 INFO [Listener at localhost/46739] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:38,336 INFO [Listener at localhost/46739] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42199 2023-02-16 09:00:38,336 INFO [Listener at localhost/46739] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:38,344 DEBUG [Listener at localhost/46739] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:38,344 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,346 INFO [Listener at localhost/46739] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,347 INFO [Listener at localhost/46739] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42199 connecting to ZooKeeper ensemble=127.0.0.1:57287 2023-02-16 09:00:38,354 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:421990x0, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:38,356 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:421990x0, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:38,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42199-0x1005c5c31880002 connected 2023-02-16 09:00:38,357 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:38,358 DEBUG [Listener at localhost/46739] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:38,358 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42199 2023-02-16 09:00:38,358 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42199 2023-02-16 09:00:38,359 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42199 2023-02-16 09:00:38,359 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42199 2023-02-16 09:00:38,359 DEBUG [Listener at localhost/46739] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42199 2023-02-16 09:00:38,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,362 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:38,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,363 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:38,364 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,364 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:38,364 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:38,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:38,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:38,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37727,1676538038237 from backup master directory 2023-02-16 09:00:38,367 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,367 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:38,367 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:38,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/hbase.id with ID: 45cac0c8-e82c-4ea1-b677-4f35a177ebe1 2023-02-16 09:00:38,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:38,396 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x46084099 to 127.0.0.1:57287 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:38,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fb62ea1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:38,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:38,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:38,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:38,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store-tmp 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:38,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:38,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:38,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:38,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/WALs/jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37727%2C1676538038237, suffix=, logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/WALs/jenkins-hbase4.apache.org,37727,1676538038237, archiveDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:38,466 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK] 2023-02-16 09:00:38,468 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK] 2023-02-16 09:00:38,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/WALs/jenkins-hbase4.apache.org,37727,1676538038237/jenkins-hbase4.apache.org%2C37727%2C1676538038237.1676538038452 2023-02-16 09:00:38,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK], DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK]] 2023-02-16 09:00:38,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:38,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:38,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,473 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:38,473 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:38,474 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:38,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:38,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65018817, jitterRate=-0.031144127249717712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:38,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:38,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:38,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:38,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:38,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:38,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:00:38,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:00:38,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:38,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:38,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:38,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:38,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:38,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:38,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:38,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:38,495 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:38,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:38,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:38,497 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:38,497 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:38,497 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,497 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:38,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37727,1676538038237, sessionid=0x1005c5c31880000, setting cluster-up flag (Was=false) 2023-02-16 09:00:38,503 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:38,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,510 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:38,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:38,517 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/.tmp 2023-02-16 09:00:38,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:38,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538068528 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:38,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:38,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:38,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,529 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:38,529 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:38,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:38,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:38,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:38,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:38,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:38,530 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:38,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538038530,5,FailOnTimeoutGroup] 2023-02-16 09:00:38,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538038531,5,FailOnTimeoutGroup] 2023-02-16 09:00:38,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:38,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,539 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:38,540 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:38,540 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627 2023-02-16 09:00:38,547 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:38,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:38,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/info 2023-02-16 09:00:38,550 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:38,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:38,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:38,551 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:38,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:38,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/table 2023-02-16 09:00:38,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:38,553 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,554 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740 2023-02-16 09:00:38,554 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740 2023-02-16 09:00:38,556 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:38,557 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:38,558 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:38,559 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69662107, jitterRate=0.03804628551006317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:38,559 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:38,559 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:38,559 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:38,560 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:38,560 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:38,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:38,561 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(952): ClusterId : 45cac0c8-e82c-4ea1-b677-4f35a177ebe1 2023-02-16 09:00:38,562 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:38,562 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(952): ClusterId : 45cac0c8-e82c-4ea1-b677-4f35a177ebe1 2023-02-16 09:00:38,562 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:38,563 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:38,564 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:38,565 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:38,565 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:38,567 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:38,568 DEBUG [RS:0;jenkins-hbase4:35351] zookeeper.ReadOnlyZKClient(139): Connect 0x5650dd33 to 127.0.0.1:57287 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:38,569 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:38,569 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:38,572 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:38,573 DEBUG [RS:1;jenkins-hbase4:42199] zookeeper.ReadOnlyZKClient(139): Connect 0x6379d52a to 127.0.0.1:57287 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:38,574 DEBUG [RS:0;jenkins-hbase4:35351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58972989, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:38,574 DEBUG [RS:0;jenkins-hbase4:35351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca8b643, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:38,581 DEBUG [RS:1;jenkins-hbase4:42199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dbe3735, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:38,581 DEBUG [RS:1;jenkins-hbase4:42199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6981be5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:38,584 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35351 2023-02-16 09:00:38,584 INFO [RS:0;jenkins-hbase4:35351] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:38,584 INFO [RS:0;jenkins-hbase4:35351] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:38,584 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:38,584 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37727,1676538038237 with isa=jenkins-hbase4.apache.org/172.31.14.131:35351, startcode=1676538038298 2023-02-16 09:00:38,584 DEBUG [RS:0;jenkins-hbase4:35351] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:38,586 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42789, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:38,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,588 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627 2023-02-16 09:00:38,588 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41235 2023-02-16 09:00:38,588 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:38,590 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42199 2023-02-16 09:00:38,590 INFO [RS:1;jenkins-hbase4:42199] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:38,590 INFO [RS:1;jenkins-hbase4:42199] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:38,590 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:38,590 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:38,590 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37727,1676538038237 with isa=jenkins-hbase4.apache.org/172.31.14.131:42199, startcode=1676538038333 2023-02-16 09:00:38,590 DEBUG [RS:0;jenkins-hbase4:35351] zookeeper.ZKUtil(162): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,591 DEBUG [RS:1;jenkins-hbase4:42199] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:38,591 WARN [RS:0;jenkins-hbase4:35351] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:38,591 INFO [RS:0;jenkins-hbase4:35351] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:38,591 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,591 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35351,1676538038298] 2023-02-16 09:00:38,594 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59819, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,595 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627 2023-02-16 09:00:38,595 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41235 2023-02-16 09:00:38,595 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:38,595 DEBUG [RS:0;jenkins-hbase4:35351] zookeeper.ZKUtil(162): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,599 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:38,599 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:38,599 DEBUG [RS:1;jenkins-hbase4:42199] zookeeper.ZKUtil(162): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,600 WARN [RS:1;jenkins-hbase4:42199] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:38,600 INFO [RS:1;jenkins-hbase4:42199] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:38,600 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:38,600 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,600 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42199,1676538038333] 2023-02-16 09:00:38,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,600 INFO [RS:0;jenkins-hbase4:35351] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:38,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,602 INFO [RS:0;jenkins-hbase4:35351] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:38,603 INFO [RS:0;jenkins-hbase4:35351] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:38,603 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,603 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:38,603 DEBUG [RS:1;jenkins-hbase4:42199] zookeeper.ZKUtil(162): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,604 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,604 DEBUG [RS:1;jenkins-hbase4:42199] zookeeper.ZKUtil(162): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,604 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,604 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,604 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,604 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,604 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,605 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:38,605 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,605 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,605 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,605 DEBUG [RS:0;jenkins-hbase4:35351] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,605 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:38,605 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,605 INFO [RS:1;jenkins-hbase4:42199] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:38,605 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,606 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,607 INFO [RS:1;jenkins-hbase4:42199] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:38,607 INFO [RS:1;jenkins-hbase4:42199] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:38,607 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,607 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:38,608 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,608 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,608 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,609 DEBUG [RS:1;jenkins-hbase4:42199] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:38,612 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,612 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,613 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,618 INFO [RS:0;jenkins-hbase4:35351] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:38,618 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35351,1676538038298-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,623 INFO [RS:1;jenkins-hbase4:42199] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:38,623 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42199,1676538038333-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,628 INFO [RS:0;jenkins-hbase4:35351] regionserver.Replication(203): jenkins-hbase4.apache.org,35351,1676538038298 started 2023-02-16 09:00:38,629 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35351,1676538038298, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35351, sessionid=0x1005c5c31880001 2023-02-16 09:00:38,629 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:38,629 DEBUG [RS:0;jenkins-hbase4:35351] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,629 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35351,1676538038298' 2023-02-16 09:00:38,629 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:38,629 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35351,1676538038298' 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:38,630 DEBUG [RS:0;jenkins-hbase4:35351] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:38,630 INFO [RS:0;jenkins-hbase4:35351] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:38,630 INFO [RS:0;jenkins-hbase4:35351] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:38,634 INFO [RS:1;jenkins-hbase4:42199] regionserver.Replication(203): jenkins-hbase4.apache.org,42199,1676538038333 started 2023-02-16 09:00:38,634 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42199,1676538038333, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42199, sessionid=0x1005c5c31880002 2023-02-16 09:00:38,634 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:38,634 DEBUG [RS:1;jenkins-hbase4:42199] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,634 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42199,1676538038333' 2023-02-16 09:00:38,634 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42199,1676538038333' 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:38,635 DEBUG [RS:1;jenkins-hbase4:42199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:38,636 DEBUG [RS:1;jenkins-hbase4:42199] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:38,636 INFO [RS:1;jenkins-hbase4:42199] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:38,636 INFO [RS:1;jenkins-hbase4:42199] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:38,714 DEBUG [jenkins-hbase4:37727] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:38,714 DEBUG [jenkins-hbase4:37727] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:38,716 DEBUG [jenkins-hbase4:37727] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:38,716 DEBUG [jenkins-hbase4:37727] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:38,716 DEBUG [jenkins-hbase4:37727] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:38,717 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35351,1676538038298, state=OPENING 2023-02-16 09:00:38,718 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:38,719 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:38,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35351,1676538038298}] 2023-02-16 09:00:38,720 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:38,874 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:38,874 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:38,876 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:38,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:38,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:38,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35351%2C1676538038298.meta, suffix=.meta, logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,35351,1676538038298, archiveDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs, maxLogs=32 2023-02-16 09:00:38,896 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK] 2023-02-16 09:00:38,897 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK] 2023-02-16 09:00:38,900 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,35351,1676538038298/jenkins-hbase4.apache.org%2C35351%2C1676538038298.meta.1676538038883.meta 2023-02-16 09:00:38,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK], DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK]] 2023-02-16 09:00:38,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:38,901 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:38,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:38,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/info 2023-02-16 09:00:38,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/info 2023-02-16 09:00:38,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:38,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:38,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:38,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:38,912 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:38,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:38,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/table 2023-02-16 09:00:38,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/table 2023-02-16 09:00:38,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:38,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:38,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740 2023-02-16 09:00:38,920 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740 2023-02-16 09:00:38,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:38,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:38,935 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71527947, jitterRate=0.06584946811199188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:38,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:38,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538038874 2023-02-16 09:00:38,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:38,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:38,940 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35351,1676538038298, state=OPEN 2023-02-16 09:00:38,941 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:38,942 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:38,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:38,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35351,1676538038298 in 222 msec 2023-02-16 09:00:38,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:38,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 383 msec 2023-02-16 09:00:38,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 427 msec 2023-02-16 09:00:38,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538038946, completionTime=-1 2023-02-16 09:00:38,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:38,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:38,949 DEBUG [hconnection-0x14aaa41f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:38,951 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:38,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:38,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538098953 2023-02-16 09:00:38,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538158953 2023-02-16 09:00:38,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37727,1676538038237-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37727,1676538038237-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37727,1676538038237-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37727, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:38,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:38,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:38,967 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:38,967 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:38,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:38,969 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:38,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640 empty. 2023-02-16 09:00:38,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:38,970 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:38,979 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:38,979 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 32f6bfe3526f3b4621f6282245aef640, NAME => 'hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 32f6bfe3526f3b4621f6282245aef640, disabling compactions & flushes 2023-02-16 09:00:38,987 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. after waiting 0 ms 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:38,987 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:38,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 32f6bfe3526f3b4621f6282245aef640: 2023-02-16 09:00:38,989 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:38,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538038990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538038990"}]},"ts":"1676538038990"} 2023-02-16 09:00:38,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:38,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:38,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538038993"}]},"ts":"1676538038993"} 2023-02-16 09:00:38,994 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:38,997 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:38,998 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:38,998 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:38,998 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:38,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=32f6bfe3526f3b4621f6282245aef640, ASSIGN}] 2023-02-16 09:00:39,000 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=32f6bfe3526f3b4621f6282245aef640, ASSIGN 2023-02-16 09:00:39,001 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=32f6bfe3526f3b4621f6282245aef640, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42199,1676538038333; forceNewPlan=false, retain=false 2023-02-16 09:00:39,151 INFO [jenkins-hbase4:37727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:39,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=32f6bfe3526f3b4621f6282245aef640, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:39,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538039151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538039151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538039151"}]},"ts":"1676538039151"} 2023-02-16 09:00:39,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 32f6bfe3526f3b4621f6282245aef640, server=jenkins-hbase4.apache.org,42199,1676538038333}] 2023-02-16 09:00:39,306 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:39,306 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:39,310 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:39,324 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:39,326 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42199%2C1676538038333, suffix=, logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,42199,1676538038333, archiveDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs, maxLogs=32 2023-02-16 09:00:39,348 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK] 2023-02-16 09:00:39,350 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:00:39,360 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK] 2023-02-16 09:00:39,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,42199,1676538038333/jenkins-hbase4.apache.org%2C42199%2C1676538038333.1676538039328 2023-02-16 09:00:39,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK], DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK]] 2023-02-16 09:00:39,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 32f6bfe3526f3b4621f6282245aef640, NAME => 'hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:39,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:39,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,458 INFO [StoreOpener-32f6bfe3526f3b4621f6282245aef640-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,472 DEBUG [StoreOpener-32f6bfe3526f3b4621f6282245aef640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/info 2023-02-16 09:00:39,475 DEBUG [StoreOpener-32f6bfe3526f3b4621f6282245aef640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/info 2023-02-16 09:00:39,480 INFO [StoreOpener-32f6bfe3526f3b4621f6282245aef640-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32f6bfe3526f3b4621f6282245aef640 columnFamilyName info 2023-02-16 09:00:39,483 INFO [StoreOpener-32f6bfe3526f3b4621f6282245aef640-1] regionserver.HStore(310): Store=32f6bfe3526f3b4621f6282245aef640/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:39,485 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,486 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:39,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:39,495 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 32f6bfe3526f3b4621f6282245aef640; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63216365, jitterRate=-0.05800275504589081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:39,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 32f6bfe3526f3b4621f6282245aef640: 2023-02-16 09:00:39,497 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640., pid=6, masterSystemTime=1676538039306 2023-02-16 09:00:39,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:39,502 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:39,502 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=32f6bfe3526f3b4621f6282245aef640, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:39,502 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538039502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538039502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538039502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538039502"}]},"ts":"1676538039502"} 2023-02-16 09:00:39,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:39,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 32f6bfe3526f3b4621f6282245aef640, server=jenkins-hbase4.apache.org,42199,1676538038333 in 350 msec 2023-02-16 09:00:39,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:39,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=32f6bfe3526f3b4621f6282245aef640, ASSIGN in 508 msec 2023-02-16 09:00:39,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:39,510 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538039510"}]},"ts":"1676538039510"} 2023-02-16 09:00:39,517 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:39,535 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:39,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 570 msec 2023-02-16 09:00:39,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:39,577 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:39,577 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:39,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:39,581 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:39,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:39,590 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:39,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 09:00:39,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:39,601 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:39,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 09:00:39,608 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:39,611 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.244sec 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37727,1676538038237-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37727,1676538038237-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:39,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:39,632 INFO [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35351%2C1676538038298, suffix=, logDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,35351,1676538038298, archiveDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs, maxLogs=32 2023-02-16 09:00:39,646 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK] 2023-02-16 09:00:39,646 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK] 2023-02-16 09:00:39,647 INFO [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/WALs/jenkins-hbase4.apache.org,35351,1676538038298/jenkins-hbase4.apache.org%2C35351%2C1676538038298.1676538039632 2023-02-16 09:00:39,648 DEBUG [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40127,DS-4ddbe164-442a-4b19-9c0d-a996e8a32790,DISK], DatanodeInfoWithStorage[127.0.0.1:40519,DS-d3c68f22-3f0c-46f4-bcfc-8a718bb3e42a,DISK]] 2023-02-16 09:00:39,662 DEBUG [Listener at localhost/46739] zookeeper.ReadOnlyZKClient(139): Connect 0x2f5b1d85 to 127.0.0.1:57287 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:39,666 DEBUG [Listener at localhost/46739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e6f9895, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:39,668 DEBUG [hconnection-0x24497dbe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:39,669 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60878, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:39,671 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:39,671 DEBUG [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:39,673 DEBUG [Listener at localhost/46739] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:39,674 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:39,675 INFO [Listener at localhost/46739] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:39,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:39,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:39,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:46412 deadline: 1676538099675, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:39,676 INFO [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 09:00:39,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:39,680 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:39,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-16 09:00:39,681 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:39,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:39,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:39,683 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 empty. 2023-02-16 09:00:39,683 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:39,683 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 09:00:39,693 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:39,694 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6d32acc52bc4392b94dd988319e0b8b2, NAME => 'testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 6d32acc52bc4392b94dd988319e0b8b2, disabling compactions & flushes 2023-02-16 09:00:39,700 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. after waiting 0 ms 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:39,700 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:39,700 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:39,702 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:39,703 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676538039703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538039703"}]},"ts":"1676538039703"} 2023-02-16 09:00:39,704 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:39,705 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:39,705 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538039705"}]},"ts":"1676538039705"} 2023-02-16 09:00:39,706 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-16 09:00:39,710 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:39,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:39,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:39,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:39,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, ASSIGN}] 2023-02-16 09:00:39,713 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, ASSIGN 2023-02-16 09:00:39,714 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42199,1676538038333; forceNewPlan=false, retain=false 2023-02-16 09:00:39,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:39,864 INFO [jenkins-hbase4:37727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:39,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6d32acc52bc4392b94dd988319e0b8b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:39,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676538039865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538039865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538039865"}]},"ts":"1676538039865"} 2023-02-16 09:00:39,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 6d32acc52bc4392b94dd988319e0b8b2, server=jenkins-hbase4.apache.org,42199,1676538038333}] 2023-02-16 09:00:39,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:40,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6d32acc52bc4392b94dd988319e0b8b2, NAME => 'testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,024 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,025 DEBUG [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1 2023-02-16 09:00:40,025 DEBUG [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1 2023-02-16 09:00:40,025 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d32acc52bc4392b94dd988319e0b8b2 columnFamilyName f1 2023-02-16 09:00:40,026 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] regionserver.HStore(310): Store=6d32acc52bc4392b94dd988319e0b8b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:40,026 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,027 DEBUG [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2 2023-02-16 09:00:40,027 DEBUG [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2 2023-02-16 09:00:40,028 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d32acc52bc4392b94dd988319e0b8b2 columnFamilyName f2 2023-02-16 09:00:40,028 INFO [StoreOpener-6d32acc52bc4392b94dd988319e0b8b2-1] regionserver.HStore(310): Store=6d32acc52bc4392b94dd988319e0b8b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:40,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:40,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:40,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:40,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6d32acc52bc4392b94dd988319e0b8b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59752514, jitterRate=-0.1096181571483612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:40,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:40,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2., pid=12, masterSystemTime=1676538040019 2023-02-16 09:00:40,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6d32acc52bc4392b94dd988319e0b8b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,037 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676538040037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538040037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538040037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538040037"}]},"ts":"1676538040037"} 2023-02-16 09:00:40,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 09:00:40,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 6d32acc52bc4392b94dd988319e0b8b2, server=jenkins-hbase4.apache.org,42199,1676538038333 in 172 msec 2023-02-16 09:00:40,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 09:00:40,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, ASSIGN in 329 msec 2023-02-16 09:00:40,042 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:40,043 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538040043"}]},"ts":"1676538040043"} 2023-02-16 09:00:40,044 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-16 09:00:40,046 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:40,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 368 msec 2023-02-16 09:00:40,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:40,287 INFO [Listener at localhost/46739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-16 09:00:40,287 DEBUG [Listener at localhost/46739] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-16 09:00:40,287 INFO [Listener at localhost/46739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:40,289 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-16 09:00:40,289 INFO [Listener at localhost/46739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:40,290 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-16 09:00:40,290 INFO [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:40,313 DEBUG [hconnection-0x24497dbe-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:40,336 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:40,346 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42199] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,492 INFO [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:40,492 INFO [Listener at localhost/46739] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:40,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 09:00:40,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538040493 (current time:1676538040493). 2023-02-16 09:00:40,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] zookeeper.ReadOnlyZKClient(139): Connect 0x640fc0f4 to 127.0.0.1:57287 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:40,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67e91fa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:40,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:40,502 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x640fc0f4 to 127.0.0.1:57287 2023-02-16 09:00:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 09:00:40,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 09:00:40,507 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 09:00:40,508 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676538640508 2023-02-16 09:00:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 09:00:40,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,509 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:40,510 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:40,510 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 09:00:40,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 09:00:40,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-16 09:00:40,512 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 09:00:40,513 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676538640513 2023-02-16 09:00:40,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 09:00:40,523 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 09:00:40,523 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:40,524 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 09:00:40,524 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 09:00:40,525 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,525 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,526 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:40,526 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:40,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:40,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:40,526 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:40,527 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,527 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 09:00:40,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 09:00:40,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 09:00:40,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 09:00:40,528 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 09:00:40,528 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:40,528 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 09:00:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 09:00:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 09:00:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42199,1676538038333' joining acquired barrier for procedure (foo) in zk 2023-02-16 09:00:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 09:00:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 09:00:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35351,1676538038298' joining acquired barrier for procedure (foo) in zk 2023-02-16 09:00:40,531 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,531 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:40,531 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:40,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42199,1676538038333' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 09:00:40,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f79e5ca[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:40,541 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 09:00:40,541 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,542 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 09:00:40,542 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 09:00:40,543 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 09:00:40,543 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35351,1676538038298' in zk 2023-02-16 09:00:40,543 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,543 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:40,548 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 09:00:40,548 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:40,548 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,548 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 09:00:40,549 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. started... 2023-02-16 09:00:40,549 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:40,549 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 09:00:40,550 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6d32acc52bc4392b94dd988319e0b8b2 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 09:00:40,574 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f1/621daa92222249879bde1660325cc71d 2023-02-16 09:00:40,594 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f2/e2eacea1d7304508abeb5c63a06fadc0 2023-02-16 09:00:40,598 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f1/621daa92222249879bde1660325cc71d as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d 2023-02-16 09:00:40,602 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:40,603 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f2/e2eacea1d7304508abeb5c63a06fadc0 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0 2023-02-16 09:00:40,608 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:40,608 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 6d32acc52bc4392b94dd988319e0b8b2 in 58ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.' region-info for snapshot=foo 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d] hfiles 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d for snapshot=foo 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0] hfiles 2023-02-16 09:00:40,609 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0 for snapshot=foo 2023-02-16 09:00:40,610 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:40,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 09:00:40,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:40,612 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:40,615 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. completed. 2023-02-16 09:00:40,615 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 09:00:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 09:00:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 09:00:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42199,1676538038333' in zk 2023-02-16 09:00:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 09:00:40,617 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 09:00:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42199,1676538038333': 2023-02-16 09:00:40,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42199,1676538038333' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 09:00:40,622 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 09:00:40,622 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:40,622 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:40,622 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 09:00:40,622 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:40,625 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:40,625 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,625 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:40,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:40,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:40,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:40,626 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:40,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:40,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,627 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,628 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:40,629 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:40,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:40,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:40,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:40,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:40,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 09:00:40,634 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:40,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 09:00:40,634 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:40,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:40,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:40,639 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:40,640 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:40,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/.tmp/foo to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/foo 2023-02-16 09:00:40,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-16 09:00:40,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:40,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:40,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676538040509Consolidate snapshot: foo at 1676538040635 (+126 ms)Loading Region manifests for foo at 1676538040635Writing data manifest for foo at 1676538040642 (+7 ms)Verifying snapshot: foo at 1676538040651 (+9 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676538040672 (+21 ms) 2023-02-16 09:00:40,674 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 09:00:40,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 164 msec 2023-02-16 09:00:40,812 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:40,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 09:00:40,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:40,814 INFO [Listener at localhost/46739] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:40,818 INFO [Listener at localhost/46739] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:40,823 INFO [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:40,862 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42199] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:40,970 INFO [Listener at localhost/46739] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:40,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:40,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,980 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-16 09:00:40,980 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:40,981 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-16 09:00:40,981 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-16 09:00:40,982 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,982 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,983 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:40,983 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:40,983 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,984 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:40,984 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:40,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,985 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:40,985 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 09:00:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:41,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 09:00:41,004 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 09:00:41,004 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:41,004 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 09:00:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 09:00:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 09:00:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35351,1676538038298' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 09:00:41,006 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,006 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. started... 2023-02-16 09:00:41,006 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d32acc52bc4392b94dd988319e0b8b2 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 09:00:41,009 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,010 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,010 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:41,057 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f1/88bcd549a4264b59a0db5ec957668102 2023-02-16 09:00:41,084 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f2/5166bbb3b5b941d7b9dd9464fc9a6835 2023-02-16 09:00:41,089 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f1/88bcd549a4264b59a0db5ec957668102 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/88bcd549a4264b59a0db5ec957668102 2023-02-16 09:00:41,093 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/88bcd549a4264b59a0db5ec957668102, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:41,093 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/.tmp/f2/5166bbb3b5b941d7b9dd9464fc9a6835 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/5166bbb3b5b941d7b9dd9464fc9a6835 2023-02-16 09:00:41,097 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/5166bbb3b5b941d7b9dd9464fc9a6835, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:41,098 INFO [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 6d32acc52bc4392b94dd988319e0b8b2 in 92ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:41,099 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:41,099 DEBUG [rs(jenkins-hbase4.apache.org,42199,1676538038333)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 09:00:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 09:00:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 09:00:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42199,1676538038333' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 09:00:41,101 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,101 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:41,101 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,101 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:41,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42199,1676538038333' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-16 09:00:41,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b4674fd[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:41,103 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-16 09:00:41,103 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,104 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 09:00:41,105 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 09:00:41,105 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,105 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:41,105 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 09:00:41,105 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,42199,1676538038333' in zk 2023-02-16 09:00:41,105 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 09:00:41,105 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,35351,1676538038298' in zk 2023-02-16 09:00:41,106 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 09:00:41,106 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,106 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:41,106 DEBUG [member: 'jenkins-hbase4.apache.org,42199,1676538038333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 09:00:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 09:00:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,35351,1676538038298' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 09:00:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,42199,1676538038333': 2023-02-16 09:00:41,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42199,1676538038333' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-16 09:00:41,111 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-16 09:00:41,111 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:41,111 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:41,111 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,111 INFO [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:41,112 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,112 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:41,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:41,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:41,113 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,114 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,115 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:41,115 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:41,118 DEBUG [(jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:41,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-16 09:00:41,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:41,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:41,118 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:41,117 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:41,118 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:41,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:41,119 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:41,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:41,219 DEBUG [Listener at localhost/46739] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:41,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:41,225 INFO [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676538040493 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:41,225 DEBUG [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41235/user/jenkins/test-data/7790f088-cc9f-e3a1-077b-db0ce345ce66/foo/f4c3e008-92be-4fd5-8fab-1fb4914d20a6/data/default/testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,225 INFO [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(239): region to add: 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:41,226 INFO [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(585): clone region=6d32acc52bc4392b94dd988319e0b8b2 as 6d32acc52bc4392b94dd988319e0b8b2 in snapshot foo 2023-02-16 09:00:41,226 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6d32acc52bc4392b94dd988319e0b8b2, NAME => 'testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41235/user/jenkins/test-data/7790f088-cc9f-e3a1-077b-db0ce345ce66/foo/f4c3e008-92be-4fd5-8fab-1fb4914d20a6 2023-02-16 09:00:41,233 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:41,233 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 621daa92222249879bde1660325cc71d from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,235 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2eacea1d7304508abeb5c63a06fadc0 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6d32acc52bc4392b94dd988319e0b8b2, disabling compactions & flushes 2023-02-16 09:00:41,237 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. after waiting 0 ms 2023-02-16 09:00:41,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,237 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,237 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:41,237 INFO [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676538040493 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:41,237 DEBUG [Listener at localhost/46739] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41235/user/jenkins/test-data/7790f088-cc9f-e3a1-077b-db0ce345ce66/foo/f4c3e008-92be-4fd5-8fab-1fb4914d20a6 2023-02-16 09:00:41,237 DEBUG [Listener at localhost/46739] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41235/user/jenkins/test-data/7790f088-cc9f-e3a1-077b-db0ce345ce66/foo/f4c3e008-92be-4fd5-8fab-1fb4914d20a6 2023-02-16 09:00:41,238 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:41,238 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:41,239 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-16 09:00:41,239 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |----------6d32acc52bc4392b94dd988319e0b8b2/ 2023-02-16 09:00:41,240 DEBUG [Listener at localhost/46739] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:41,240 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:41,240 DEBUG [Listener at localhost/46739] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=6d32acc52bc4392b94dd988319e0b8b2-621daa92222249879bde1660325cc71d 2023-02-16 09:00:41,240 DEBUG [Listener at localhost/46739] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:41,241 DEBUG [Listener at localhost/46739] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=6d32acc52bc4392b94dd988319e0b8b2-e2eacea1d7304508abeb5c63a06fadc0 2023-02-16 09:00:41,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 09:00:41,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 09:00:41,245 INFO [Listener at localhost/46739] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:41,249 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538041249"}]},"ts":"1676538041249"} 2023-02-16 09:00:41,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-16 09:00:41,252 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-16 09:00:41,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, UNASSIGN}] 2023-02-16 09:00:41,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, UNASSIGN 2023-02-16 09:00:41,254 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6d32acc52bc4392b94dd988319e0b8b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,254 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676538041254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538041254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538041254"}]},"ts":"1676538041254"} 2023-02-16 09:00:41,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 6d32acc52bc4392b94dd988319e0b8b2, server=jenkins-hbase4.apache.org,42199,1676538038333}] 2023-02-16 09:00:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:41,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:41,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6d32acc52bc4392b94dd988319e0b8b2, disabling compactions & flushes 2023-02-16 09:00:41,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. after waiting 0 ms 2023-02-16 09:00:41,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:41,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2. 2023-02-16 09:00:41,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6d32acc52bc4392b94dd988319e0b8b2: 2023-02-16 09:00:41,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:41,414 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6d32acc52bc4392b94dd988319e0b8b2, regionState=CLOSED 2023-02-16 09:00:41,414 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676538041414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538041414"}]},"ts":"1676538041414"} 2023-02-16 09:00:41,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 09:00:41,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 6d32acc52bc4392b94dd988319e0b8b2, server=jenkins-hbase4.apache.org,42199,1676538038333 in 159 msec 2023-02-16 09:00:41,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 09:00:41,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=6d32acc52bc4392b94dd988319e0b8b2, UNASSIGN in 165 msec 2023-02-16 09:00:41,418 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538041418"}]},"ts":"1676538041418"} 2023-02-16 09:00:41,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-16 09:00:41,422 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-16 09:00:41,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-16 09:00:41,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:41,552 INFO [Listener at localhost/46739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-16 09:00:41,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:41,560 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,563 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:41,565 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1, FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2, FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/recovered.edits] 2023-02-16 09:00:41,569 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/archive/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/621daa92222249879bde1660325cc71d 2023-02-16 09:00:41,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/88bcd549a4264b59a0db5ec957668102 to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/archive/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f1/88bcd549a4264b59a0db5ec957668102 2023-02-16 09:00:41,573 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/5166bbb3b5b941d7b9dd9464fc9a6835 to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/archive/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/5166bbb3b5b941d7b9dd9464fc9a6835 2023-02-16 09:00:41,575 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0 to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/archive/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/f2/e2eacea1d7304508abeb5c63a06fadc0 2023-02-16 09:00:41,577 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/recovered.edits/12.seqid to hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/archive/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2/recovered.edits/12.seqid 2023-02-16 09:00:41,577 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/.tmp/data/default/testInitTableSnapshotMapperJobConfig/6d32acc52bc4392b94dd988319e0b8b2 2023-02-16 09:00:41,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 09:00:41,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,581 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-16 09:00:41,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-16 09:00:41,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-16 09:00:41,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538041584"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:41,585 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 09:00:41,585 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6d32acc52bc4392b94dd988319e0b8b2, NAME => 'testInitTableSnapshotMapperJobConfig,,1676538039677.6d32acc52bc4392b94dd988319e0b8b2.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 09:00:41,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-16 09:00:41,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538041585"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:41,589 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-16 09:00:41,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 09:00:41,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 38 msec 2023-02-16 09:00:41,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:41,658 INFO [Listener at localhost/46739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-16 09:00:41,659 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:41,659 INFO [Listener at localhost/46739] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:41,659 DEBUG [Listener at localhost/46739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f5b1d85 to 127.0.0.1:57287 2023-02-16 09:00:41,659 DEBUG [Listener at localhost/46739] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,659 DEBUG [Listener at localhost/46739] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:41,659 DEBUG [Listener at localhost/46739] util.JVMClusterUtil(257): Found active master hash=1872552297, stopped=false 2023-02-16 09:00:41,659 INFO [Listener at localhost/46739] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:41,662 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:41,663 INFO [Listener at localhost/46739] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:41,663 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:41,662 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:41,662 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:41,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:41,664 DEBUG [Listener at localhost/46739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46084099 to 127.0.0.1:57287 2023-02-16 09:00:41,664 DEBUG [Listener at localhost/46739] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,665 INFO [Listener at localhost/46739] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35351,1676538038298' ***** 2023-02-16 09:00:41,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:41,665 INFO [Listener at localhost/46739] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:41,665 INFO [Listener at localhost/46739] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42199,1676538038333' ***** 2023-02-16 09:00:41,665 INFO [Listener at localhost/46739] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:41,665 INFO [RS:0;jenkins-hbase4:35351] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:41,665 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:41,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:41,665 INFO [RS:0;jenkins-hbase4:35351] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:41,666 INFO [RS:0;jenkins-hbase4:35351] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:41,666 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,667 DEBUG [RS:0;jenkins-hbase4:35351] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5650dd33 to 127.0.0.1:57287 2023-02-16 09:00:41,667 INFO [RS:1;jenkins-hbase4:42199] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:41,667 DEBUG [RS:0;jenkins-hbase4:35351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,667 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:41,667 INFO [RS:1;jenkins-hbase4:42199] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:41,667 INFO [RS:0;jenkins-hbase4:35351] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:41,668 INFO [RS:1;jenkins-hbase4:42199] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:41,668 INFO [RS:0;jenkins-hbase4:35351] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:41,668 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(3304): Received CLOSE for 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:41,668 INFO [RS:0;jenkins-hbase4:35351] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:41,668 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,668 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:41,668 DEBUG [RS:1;jenkins-hbase4:42199] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6379d52a to 127.0.0.1:57287 2023-02-16 09:00:41,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 32f6bfe3526f3b4621f6282245aef640, disabling compactions & flushes 2023-02-16 09:00:41,669 DEBUG [RS:1;jenkins-hbase4:42199] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,669 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 09:00:41,669 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 09:00:41,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:41,670 DEBUG [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:41,669 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. after waiting 0 ms 2023-02-16 09:00:41,670 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1479): Online Regions={32f6bfe3526f3b4621f6282245aef640=hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640.} 2023-02-16 09:00:41,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:41,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:41,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-16 09:00:41,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 32f6bfe3526f3b4621f6282245aef640 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:41,670 DEBUG [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1505): Waiting on 32f6bfe3526f3b4621f6282245aef640 2023-02-16 09:00:41,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/.tmp/info/59ccb5bf3da74551bf899897f61facba 2023-02-16 09:00:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/.tmp/info/59ccb5bf3da74551bf899897f61facba as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/info/59ccb5bf3da74551bf899897f61facba 2023-02-16 09:00:41,694 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 09:00:41,694 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 09:00:41,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/info/59ccb5bf3da74551bf899897f61facba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:41,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 32f6bfe3526f3b4621f6282245aef640 in 33ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:41,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/info/ccc4570b8c9e426c866dad57f4202ba7 2023-02-16 09:00:41,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/namespace/32f6bfe3526f3b4621f6282245aef640/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:41,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:41,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 32f6bfe3526f3b4621f6282245aef640: 2023-02-16 09:00:41,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538038965.32f6bfe3526f3b4621f6282245aef640. 2023-02-16 09:00:41,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccc4570b8c9e426c866dad57f4202ba7 2023-02-16 09:00:41,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/rep_barrier/86f51536d64641cf88d86db7aca17045 2023-02-16 09:00:41,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86f51536d64641cf88d86db7aca17045 2023-02-16 09:00:41,741 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:41,742 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:41,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/table/f23ffcbbdab34002a28f44ec5bda1ed2 2023-02-16 09:00:41,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f23ffcbbdab34002a28f44ec5bda1ed2 2023-02-16 09:00:41,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/info/ccc4570b8c9e426c866dad57f4202ba7 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/info/ccc4570b8c9e426c866dad57f4202ba7 2023-02-16 09:00:41,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccc4570b8c9e426c866dad57f4202ba7 2023-02-16 09:00:41,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/info/ccc4570b8c9e426c866dad57f4202ba7, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 09:00:41,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/rep_barrier/86f51536d64641cf88d86db7aca17045 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/rep_barrier/86f51536d64641cf88d86db7aca17045 2023-02-16 09:00:41,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86f51536d64641cf88d86db7aca17045 2023-02-16 09:00:41,764 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/rep_barrier/86f51536d64641cf88d86db7aca17045, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 09:00:41,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/.tmp/table/f23ffcbbdab34002a28f44ec5bda1ed2 as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/table/f23ffcbbdab34002a28f44ec5bda1ed2 2023-02-16 09:00:41,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f23ffcbbdab34002a28f44ec5bda1ed2 2023-02-16 09:00:41,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/table/f23ffcbbdab34002a28f44ec5bda1ed2, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 09:00:41,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 109ms, sequenceid=21, compaction requested=false 2023-02-16 09:00:41,788 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 09:00:41,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:41,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:41,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:41,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:41,870 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35351,1676538038298; all regions closed. 2023-02-16 09:00:41,870 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42199,1676538038333; all regions closed. 2023-02-16 09:00:41,877 DEBUG [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs 2023-02-16 09:00:41,877 INFO [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35351%2C1676538038298.meta:.meta(num 1676538038883) 2023-02-16 09:00:41,886 DEBUG [RS:1;jenkins-hbase4:42199] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs 2023-02-16 09:00:41,886 INFO [RS:1;jenkins-hbase4:42199] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42199%2C1676538038333:(num 1676538039328) 2023-02-16 09:00:41,886 DEBUG [RS:1;jenkins-hbase4:42199] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,887 INFO [RS:1;jenkins-hbase4:42199] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:41,887 INFO [RS:1;jenkins-hbase4:42199] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:41,887 INFO [RS:1;jenkins-hbase4:42199] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:41,887 INFO [RS:1;jenkins-hbase4:42199] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:41,887 INFO [RS:1;jenkins-hbase4:42199] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:41,887 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:41,888 INFO [RS:1;jenkins-hbase4:42199] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42199 2023-02-16 09:00:41,890 DEBUG [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/oldWALs 2023-02-16 09:00:41,890 INFO [RS:0;jenkins-hbase4:35351] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35351%2C1676538038298:(num 1676538039632) 2023-02-16 09:00:41,890 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,890 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42199,1676538038333 2023-02-16 09:00:41,890 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:41,890 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:41,890 DEBUG [RS:0;jenkins-hbase4:35351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,890 INFO [RS:0;jenkins-hbase4:35351] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:41,890 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:41,890 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1696502a rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:41,890 INFO [RS:0;jenkins-hbase4:35351] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:41,891 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:41,891 INFO [RS:0;jenkins-hbase4:35351] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35351 2023-02-16 09:00:41,892 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42199,1676538038333] 2023-02-16 09:00:41,892 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42199,1676538038333; numProcessing=1 2023-02-16 09:00:41,893 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35351,1676538038298 2023-02-16 09:00:41,893 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:41,895 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42199,1676538038333 already deleted, retry=false 2023-02-16 09:00:41,895 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42199,1676538038333 expired; onlineServers=1 2023-02-16 09:00:41,896 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35351,1676538038298] 2023-02-16 09:00:41,896 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35351,1676538038298; numProcessing=2 2023-02-16 09:00:41,896 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35351,1676538038298 already deleted, retry=false 2023-02-16 09:00:41,896 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35351,1676538038298 expired; onlineServers=0 2023-02-16 09:00:41,896 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37727,1676538038237' ***** 2023-02-16 09:00:41,897 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:41,897 DEBUG [M:0;jenkins-hbase4:37727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ba37842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:41,897 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37727,1676538038237 2023-02-16 09:00:41,897 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37727,1676538038237; all regions closed. 2023-02-16 09:00:41,897 DEBUG [M:0;jenkins-hbase4:37727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:41,897 DEBUG [M:0;jenkins-hbase4:37727] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:41,897 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:41,897 DEBUG [M:0;jenkins-hbase4:37727] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:41,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538038531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538038531,5,FailOnTimeoutGroup] 2023-02-16 09:00:41,898 INFO [M:0;jenkins-hbase4:37727] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:41,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538038530] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538038530,5,FailOnTimeoutGroup] 2023-02-16 09:00:41,899 INFO [M:0;jenkins-hbase4:37727] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:41,899 INFO [M:0;jenkins-hbase4:37727] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:41,899 DEBUG [M:0;jenkins-hbase4:37727] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:41,899 INFO [M:0;jenkins-hbase4:37727] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:41,900 ERROR [M:0;jenkins-hbase4:37727] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:00:41,900 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:41,900 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:41,900 INFO [M:0;jenkins-hbase4:37727] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:41,900 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:41,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:41,900 DEBUG [M:0;jenkins-hbase4:37727] zookeeper.ZKUtil(398): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:41,900 WARN [M:0;jenkins-hbase4:37727] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:41,900 INFO [M:0;jenkins-hbase4:37727] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:41,901 INFO [M:0;jenkins-hbase4:37727] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:41,901 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:41,901 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:41,901 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:41,901 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:41,901 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:41,901 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-16 09:00:41,912 INFO [M:0;jenkins-hbase4:37727] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/edc91d49bd8241cb9f3aad04a77edead 2023-02-16 09:00:41,916 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/edc91d49bd8241cb9f3aad04a77edead as hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/edc91d49bd8241cb9f3aad04a77edead 2023-02-16 09:00:41,920 INFO [M:0;jenkins-hbase4:37727] regionserver.HStore(1080): Added hdfs://localhost:41235/user/jenkins/test-data/e36d79d1-b6a8-d652-4569-763bc4bdb627/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/edc91d49bd8241cb9f3aad04a77edead, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 09:00:41,920 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-16 09:00:41,921 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:41,921 DEBUG [M:0;jenkins-hbase4:37727] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:41,924 INFO [M:0;jenkins-hbase4:37727] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:41,924 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:41,925 INFO [M:0;jenkins-hbase4:37727] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37727 2023-02-16 09:00:41,927 DEBUG [M:0;jenkins-hbase4:37727] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37727,1676538038237 already deleted, retry=false 2023-02-16 09:00:42,164 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,164 INFO [M:0;jenkins-hbase4:37727] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37727,1676538038237; zookeeper connection closed. 2023-02-16 09:00:42,164 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e71e0d5 rejected from java.util.concurrent.ThreadPoolExecutor@1a4e77c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,165 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): master:37727-0x1005c5c31880000, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,165 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7fbf2630 rejected from java.util.concurrent.ThreadPoolExecutor@1a4e77c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,264 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,264 INFO [RS:0;jenkins-hbase4:35351] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35351,1676538038298; zookeeper connection closed. 2023-02-16 09:00:42,264 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@363ed008 rejected from java.util.concurrent.ThreadPoolExecutor@32015217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 20] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,264 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:35351-0x1005c5c31880001, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,264 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@640e7b5 rejected from java.util.concurrent.ThreadPoolExecutor@32015217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 20] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,264 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@153f47aa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@153f47aa 2023-02-16 09:00:42,364 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,364 INFO [RS:1;jenkins-hbase4:42199] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42199,1676538038333; zookeeper connection closed. 2023-02-16 09:00:42,364 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4205d689 rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,364 DEBUG [Listener at localhost/46739-EventThread] zookeeper.ZKWatcher(600): regionserver:42199-0x1005c5c31880002, quorum=127.0.0.1:57287, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:42,364 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@391cf91a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@391cf91a 2023-02-16 09:00:42,364 ERROR [Listener at localhost/46739-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3af21bc3 rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:42,364 INFO [Listener at localhost/46739] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:42,365 WARN [Listener at localhost/46739] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:42,368 INFO [Listener at localhost/46739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:42,473 WARN [BP-802423738-172.31.14.131-1676538037588 heartbeating to localhost/127.0.0.1:41235] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:42,473 WARN [BP-802423738-172.31.14.131-1676538037588 heartbeating to localhost/127.0.0.1:41235] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-802423738-172.31.14.131-1676538037588 (Datanode Uuid 5b845b75-ea62-4bc2-b872-28c16581433a) service to localhost/127.0.0.1:41235 2023-02-16 09:00:42,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/dfs/data/data3/current/BP-802423738-172.31.14.131-1676538037588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:42,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/dfs/data/data4/current/BP-802423738-172.31.14.131-1676538037588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:42,476 WARN [Listener at localhost/46739] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:42,480 INFO [Listener at localhost/46739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:42,585 WARN [BP-802423738-172.31.14.131-1676538037588 heartbeating to localhost/127.0.0.1:41235] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:42,585 WARN [BP-802423738-172.31.14.131-1676538037588 heartbeating to localhost/127.0.0.1:41235] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-802423738-172.31.14.131-1676538037588 (Datanode Uuid 1d4919c4-9c77-402c-8e4a-cb825030722a) service to localhost/127.0.0.1:41235 2023-02-16 09:00:42,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/dfs/data/data1/current/BP-802423738-172.31.14.131-1676538037588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:42,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/cluster_56d16d71-f3ca-2613-9355-d88581af73b3/dfs/data/data2/current/BP-802423738-172.31.14.131-1676538037588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:42,597 INFO [Listener at localhost/46739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:42,713 INFO [Listener at localhost/46739] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:00:42,746 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:00:42,763 INFO [Listener at localhost/46739] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 158) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:41235 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:41235 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41235 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41235 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46739 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41235 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37727,1676538038237)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41235 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41235 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=575 (was 546) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 280), ProcessCount=169 (was 169), AvailableMemoryMB=1684 (was 1785) 2023-02-16 09:00:42,775 INFO [Listener at localhost/46739] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=575, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=169, AvailableMemoryMB=1683 2023-02-16 09:00:42,789 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.log.dir so I do NOT create it in target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73 2023-02-16 09:00:42,789 WARN [Listener at localhost/46739] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:00:42,789 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.tmp.dir so I do NOT create it in target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73 2023-02-16 09:00:42,789 WARN [Listener at localhost/46739] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94bd703d-2a38-69d1-a5e6-5a1fdc237f00/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:00:42,789 DEBUG [Listener at localhost/46739] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73 2023-02-16 09:00:42,790 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:42,790 INFO [Listener at localhost/46739] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f, deleteOnExit=true 2023-02-16 09:00:42,790 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:42,790 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/test.cache.data in system properties and HBase conf 2023-02-16 09:00:42,790 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:42,791 DEBUG [Listener at localhost/46739] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:42,791 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:42,792 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:42,793 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:42,793 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:42,793 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:42,793 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:42,793 INFO [Listener at localhost/46739] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:42,797 WARN [Listener at localhost/46739] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:42,798 WARN [Listener at localhost/46739] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:42,844 WARN [Listener at localhost/46739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:42,846 INFO [Listener at localhost/46739] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:42,856 INFO [Listener at localhost/46739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/java.io.tmpdir/Jetty_localhost_34035_hdfs____.u8e3t1/webapp 2023-02-16 09:00:42,955 INFO [Listener at localhost/46739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34035 2023-02-16 09:00:42,959 WARN [Listener at localhost/46739] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:42,959 WARN [Listener at localhost/46739] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:42,998 WARN [Listener at localhost/38441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:43,009 WARN [Listener at localhost/38441] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:43,011 WARN [Listener at localhost/38441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:43,012 INFO [Listener at localhost/38441] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:43,017 INFO [Listener at localhost/38441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/java.io.tmpdir/Jetty_localhost_38247_datanode____.nax5d5/webapp 2023-02-16 09:00:43,122 INFO [Listener at localhost/38441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38247 2023-02-16 09:00:43,130 WARN [Listener at localhost/37673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:43,146 WARN [Listener at localhost/37673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:43,147 WARN [Listener at localhost/37673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:43,149 INFO [Listener at localhost/37673] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:43,152 INFO [Listener at localhost/37673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/java.io.tmpdir/Jetty_localhost_41689_datanode____.rau0vz/webapp 2023-02-16 09:00:43,256 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x882572696fd12d0: Processing first storage report for DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6 from datanode bd7c1801-fa10-4a34-bd47-1607c9b8d903 2023-02-16 09:00:43,256 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x882572696fd12d0: from storage DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6 node DatanodeRegistration(127.0.0.1:46311, datanodeUuid=bd7c1801-fa10-4a34-bd47-1607c9b8d903, infoPort=41647, infoSecurePort=0, ipcPort=37673, storageInfo=lv=-57;cid=testClusterID;nsid=1851462930;c=1676538042800), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:43,257 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x882572696fd12d0: Processing first storage report for DS-991fd79a-f5e1-4d97-bde8-3dbe40d83646 from datanode bd7c1801-fa10-4a34-bd47-1607c9b8d903 2023-02-16 09:00:43,257 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x882572696fd12d0: from storage DS-991fd79a-f5e1-4d97-bde8-3dbe40d83646 node DatanodeRegistration(127.0.0.1:46311, datanodeUuid=bd7c1801-fa10-4a34-bd47-1607c9b8d903, infoPort=41647, infoSecurePort=0, ipcPort=37673, storageInfo=lv=-57;cid=testClusterID;nsid=1851462930;c=1676538042800), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 09:00:43,268 INFO [Listener at localhost/37673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41689 2023-02-16 09:00:43,278 WARN [Listener at localhost/37905] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:43,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x380f57305b12028a: Processing first storage report for DS-669e3478-bb72-402d-913a-0cda4b405be2 from datanode f0f78a9f-be56-4dbc-9173-38f3be9c7f65 2023-02-16 09:00:43,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x380f57305b12028a: from storage DS-669e3478-bb72-402d-913a-0cda4b405be2 node DatanodeRegistration(127.0.0.1:36973, datanodeUuid=f0f78a9f-be56-4dbc-9173-38f3be9c7f65, infoPort=37029, infoSecurePort=0, ipcPort=37905, storageInfo=lv=-57;cid=testClusterID;nsid=1851462930;c=1676538042800), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:43,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x380f57305b12028a: Processing first storage report for DS-22df62e9-3371-45c1-adac-f6db8845e7a6 from datanode f0f78a9f-be56-4dbc-9173-38f3be9c7f65 2023-02-16 09:00:43,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x380f57305b12028a: from storage DS-22df62e9-3371-45c1-adac-f6db8845e7a6 node DatanodeRegistration(127.0.0.1:36973, datanodeUuid=f0f78a9f-be56-4dbc-9173-38f3be9c7f65, infoPort=37029, infoSecurePort=0, ipcPort=37905, storageInfo=lv=-57;cid=testClusterID;nsid=1851462930;c=1676538042800), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:43,401 DEBUG [Listener at localhost/37905] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73 2023-02-16 09:00:43,403 INFO [Listener at localhost/37905] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/zookeeper_0, clientPort=57407, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:43,404 INFO [Listener at localhost/37905] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57407 2023-02-16 09:00:43,404 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,405 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,422 INFO [Listener at localhost/37905] util.FSUtils(479): Created version file at hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794 with version=8 2023-02-16 09:00:43,422 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,423 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,424 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/hbase-staging 2023-02-16 09:00:43,426 INFO [Listener at localhost/37905] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:43,426 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,427 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,427 INFO [Listener at localhost/37905] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:43,427 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,427 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:43,427 INFO [Listener at localhost/37905] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:43,428 INFO [Listener at localhost/37905] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42815 2023-02-16 09:00:43,428 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,429 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,430 INFO [Listener at localhost/37905] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42815 connecting to ZooKeeper ensemble=127.0.0.1:57407 2023-02-16 09:00:43,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:428150x0, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:43,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42815-0x1005c5c45cf0000 connected 2023-02-16 09:00:43,457 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:43,458 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:43,458 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:43,460 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42815 2023-02-16 09:00:43,460 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42815 2023-02-16 09:00:43,460 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42815 2023-02-16 09:00:43,460 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42815 2023-02-16 09:00:43,461 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42815 2023-02-16 09:00:43,461 INFO [Listener at localhost/37905] master.HMaster(444): hbase.rootdir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794, hbase.cluster.distributed=false 2023-02-16 09:00:43,474 INFO [Listener at localhost/37905] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:43,474 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,475 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,475 INFO [Listener at localhost/37905] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:43,475 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,475 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:43,475 INFO [Listener at localhost/37905] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:43,476 INFO [Listener at localhost/37905] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36163 2023-02-16 09:00:43,476 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:43,478 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:43,478 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,479 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,480 INFO [Listener at localhost/37905] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36163 connecting to ZooKeeper ensemble=127.0.0.1:57407 2023-02-16 09:00:43,485 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:361630x0, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:43,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36163-0x1005c5c45cf0001 connected 2023-02-16 09:00:43,487 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:43,487 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:43,487 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:43,489 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36163 2023-02-16 09:00:43,490 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36163 2023-02-16 09:00:43,492 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36163 2023-02-16 09:00:43,492 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36163 2023-02-16 09:00:43,493 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36163 2023-02-16 09:00:43,503 INFO [Listener at localhost/37905] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:43,504 INFO [Listener at localhost/37905] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:43,505 INFO [Listener at localhost/37905] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40519 2023-02-16 09:00:43,505 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:43,506 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:43,507 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,508 INFO [Listener at localhost/37905] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,509 INFO [Listener at localhost/37905] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40519 connecting to ZooKeeper ensemble=127.0.0.1:57407 2023-02-16 09:00:43,512 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:405190x0, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:43,513 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:405190x0, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:43,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40519-0x1005c5c45cf0002 connected 2023-02-16 09:00:43,514 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:43,515 DEBUG [Listener at localhost/37905] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:43,517 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40519 2023-02-16 09:00:43,518 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40519 2023-02-16 09:00:43,522 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40519 2023-02-16 09:00:43,524 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40519 2023-02-16 09:00:43,525 DEBUG [Listener at localhost/37905] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40519 2023-02-16 09:00:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,531 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:43,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,533 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:43,533 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:43,533 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,533 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:43,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:43,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:43,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42815,1676538043426 from backup master directory 2023-02-16 09:00:43,537 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,537 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:43,538 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:43,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/hbase.id with ID: 7f7c8b8d-aefc-4dc3-9f68-1aacf3f87ac5 2023-02-16 09:00:43,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:43,567 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3e6820f6 to 127.0.0.1:57407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:43,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f9d67a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:43,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:43,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:43,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:43,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store-tmp 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:43,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:43,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:43,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:43,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/WALs/jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42815%2C1676538043426, suffix=, logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/WALs/jenkins-hbase4.apache.org,42815,1676538043426, archiveDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:43,614 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK] 2023-02-16 09:00:43,614 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK] 2023-02-16 09:00:43,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/WALs/jenkins-hbase4.apache.org,42815,1676538043426/jenkins-hbase4.apache.org%2C42815%2C1676538043426.1676538043600 2023-02-16 09:00:43,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK], DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK]] 2023-02-16 09:00:43,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:43,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:43,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,618 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,619 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:43,619 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:43,620 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:43,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:43,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:43,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65785201, jitterRate=-0.01972411572933197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:43,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:43,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:43,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:43,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:43,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:43,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:00:43,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:00:43,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:43,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:43,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:43,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:43,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:43,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:43,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:43,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:43,641 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:43,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:43,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:43,644 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:43,644 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:43,644 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:43,644 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42815,1676538043426, sessionid=0x1005c5c45cf0000, setting cluster-up flag (Was=false) 2023-02-16 09:00:43,650 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:43,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,657 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:43,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:43,663 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/.tmp 2023-02-16 09:00:43,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:43,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538073670 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,670 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:43,671 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:43,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:43,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:43,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:43,673 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:43,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:43,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:43,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538043673,5,FailOnTimeoutGroup] 2023-02-16 09:00:43,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538043674,5,FailOnTimeoutGroup] 2023-02-16 09:00:43,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:43,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,723 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:43,724 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:43,724 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794 2023-02-16 09:00:43,730 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(952): ClusterId : 7f7c8b8d-aefc-4dc3-9f68-1aacf3f87ac5 2023-02-16 09:00:43,730 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(952): ClusterId : 7f7c8b8d-aefc-4dc3-9f68-1aacf3f87ac5 2023-02-16 09:00:43,730 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:43,730 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:43,732 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:43,732 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:43,733 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:43,733 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:43,736 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:43,736 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:43,738 DEBUG [RS:1;jenkins-hbase4:40519] zookeeper.ReadOnlyZKClient(139): Connect 0x4e8a5f84 to 127.0.0.1:57407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:43,742 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:43,742 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:43,743 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/info 2023-02-16 09:00:43,744 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:43,745 DEBUG [RS:1;jenkins-hbase4:40519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@404da825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:43,745 DEBUG [RS:0;jenkins-hbase4:36163] zookeeper.ReadOnlyZKClient(139): Connect 0x52a78731 to 127.0.0.1:57407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:43,745 DEBUG [RS:1;jenkins-hbase4:40519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@447234f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:43,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:43,746 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:43,747 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:43,747 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:43,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:43,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:43,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/table 2023-02-16 09:00:43,751 DEBUG [RS:0;jenkins-hbase4:36163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c606315, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:43,751 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:43,751 DEBUG [RS:0;jenkins-hbase4:36163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@585fec41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:43,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:43,752 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740 2023-02-16 09:00:43,752 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740 2023-02-16 09:00:43,754 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:43,755 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:43,759 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40519 2023-02-16 09:00:43,759 INFO [RS:1;jenkins-hbase4:40519] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:43,759 INFO [RS:1;jenkins-hbase4:40519] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:43,759 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:43,759 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42815,1676538043426 with isa=jenkins-hbase4.apache.org/172.31.14.131:40519, startcode=1676538043503 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:43,760 DEBUG [RS:1;jenkins-hbase4:40519] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:43,760 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61009604, jitterRate=-0.09088605642318726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:43,760 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:43,760 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:43,761 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36163 2023-02-16 09:00:43,761 INFO [RS:0;jenkins-hbase4:36163] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:43,761 INFO [RS:0;jenkins-hbase4:36163] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:43,762 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:43,762 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:43,762 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:43,762 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42815,1676538043426 with isa=jenkins-hbase4.apache.org/172.31.14.131:36163, startcode=1676538043474 2023-02-16 09:00:43,762 DEBUG [RS:0;jenkins-hbase4:36163] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:43,762 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42241, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:43,763 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:43,763 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:43,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:43,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,764 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794 2023-02-16 09:00:43,764 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38441 2023-02-16 09:00:43,764 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:43,765 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:43,765 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46387, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:43,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,766 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:43,767 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794 2023-02-16 09:00:43,767 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38441 2023-02-16 09:00:43,767 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:43,767 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:43,772 DEBUG [RS:1;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40519,1676538043503] 2023-02-16 09:00:43,773 WARN [RS:1;jenkins-hbase4:40519] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:43,773 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36163,1676538043474] 2023-02-16 09:00:43,773 DEBUG [RS:0;jenkins-hbase4:36163] zookeeper.ZKUtil(162): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,773 INFO [RS:1;jenkins-hbase4:40519] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:43,773 WARN [RS:0;jenkins-hbase4:36163] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:43,773 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,773 INFO [RS:0;jenkins-hbase4:36163] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:43,773 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,777 DEBUG [RS:1;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,777 DEBUG [RS:0;jenkins-hbase4:36163] zookeeper.ZKUtil(162): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,778 DEBUG [RS:1;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,778 DEBUG [RS:0;jenkins-hbase4:36163] zookeeper.ZKUtil(162): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,779 DEBUG [RS:1;jenkins-hbase4:40519] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:43,779 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:43,779 INFO [RS:1;jenkins-hbase4:40519] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:43,779 INFO [RS:0;jenkins-hbase4:36163] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:43,780 INFO [RS:1;jenkins-hbase4:40519] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:43,780 INFO [RS:1;jenkins-hbase4:40519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:43,780 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,780 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:43,781 INFO [RS:0;jenkins-hbase4:36163] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:43,781 INFO [RS:0;jenkins-hbase4:36163] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:43,781 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,781 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,781 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,781 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,781 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 DEBUG [RS:1;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,782 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,783 DEBUG [RS:0;jenkins-hbase4:36163] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:43,784 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,784 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,784 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,794 INFO [RS:1;jenkins-hbase4:40519] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:43,795 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40519,1676538043503-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,796 INFO [RS:0;jenkins-hbase4:36163] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:43,796 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36163,1676538043474-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:43,805 INFO [RS:1;jenkins-hbase4:40519] regionserver.Replication(203): jenkins-hbase4.apache.org,40519,1676538043503 started 2023-02-16 09:00:43,805 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40519,1676538043503, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40519, sessionid=0x1005c5c45cf0002 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40519,1676538043503' 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40519,1676538043503' 2023-02-16 09:00:43,805 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:43,806 DEBUG [RS:1;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:43,806 DEBUG [RS:1;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:43,806 INFO [RS:1;jenkins-hbase4:40519] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:43,806 INFO [RS:1;jenkins-hbase4:40519] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:43,810 INFO [RS:0;jenkins-hbase4:36163] regionserver.Replication(203): jenkins-hbase4.apache.org,36163,1676538043474 started 2023-02-16 09:00:43,810 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36163,1676538043474, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36163, sessionid=0x1005c5c45cf0001 2023-02-16 09:00:43,810 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:43,810 DEBUG [RS:0;jenkins-hbase4:36163] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,810 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36163,1676538043474' 2023-02-16 09:00:43,810 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:43,810 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36163,1676538043474' 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:43,811 DEBUG [RS:0;jenkins-hbase4:36163] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:43,811 INFO [RS:0;jenkins-hbase4:36163] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:43,811 INFO [RS:0;jenkins-hbase4:36163] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:43,916 DEBUG [jenkins-hbase4:42815] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:43,917 DEBUG [jenkins-hbase4:42815] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:43,918 DEBUG [jenkins-hbase4:42815] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:43,918 DEBUG [jenkins-hbase4:42815] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:43,918 DEBUG [jenkins-hbase4:42815] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:43,919 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36163,1676538043474, state=OPENING 2023-02-16 09:00:43,927 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:43,928 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:43,928 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:43,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,083 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,083 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:44,085 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:44,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:44,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:44,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36163%2C1676538043474.meta, suffix=.meta, logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474, archiveDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs, maxLogs=32 2023-02-16 09:00:44,113 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK] 2023-02-16 09:00:44,114 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK] 2023-02-16 09:00:44,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474/jenkins-hbase4.apache.org%2C36163%2C1676538043474.meta.1676538044094.meta 2023-02-16 09:00:44,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK], DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK]] 2023-02-16 09:00:44,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:44,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:44,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:44,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:44,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/info 2023-02-16 09:00:44,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/info 2023-02-16 09:00:44,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:44,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:44,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:44,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:44,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:44,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:44,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:44,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:44,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/table 2023-02-16 09:00:44,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/table 2023-02-16 09:00:44,123 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:44,124 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:44,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740 2023-02-16 09:00:44,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740 2023-02-16 09:00:44,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:44,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:44,131 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74428506, jitterRate=0.10907116532325745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:44,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:44,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538044083 2023-02-16 09:00:44,137 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:44,138 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36163,1676538043474, state=OPEN 2023-02-16 09:00:44,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:44,139 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:44,139 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:44,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:44,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36163,1676538043474 in 211 msec 2023-02-16 09:00:44,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:44,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 377 msec 2023-02-16 09:00:44,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 478 msec 2023-02-16 09:00:44,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538044143, completionTime=-1 2023-02-16 09:00:44,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:44,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:44,146 DEBUG [hconnection-0x7c0b1cf5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:44,147 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:44,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:44,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538104149 2023-02-16 09:00:44,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538164149 2023-02-16 09:00:44,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42815,1676538043426-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42815,1676538043426-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42815,1676538043426-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42815, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:44,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:44,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:44,155 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:44,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:44,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:44,158 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,158 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77 empty. 2023-02-16 09:00:44,159 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,159 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:44,171 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:44,172 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f052463a33ef1bde26e436250fff4a77, NAME => 'hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f052463a33ef1bde26e436250fff4a77, disabling compactions & flushes 2023-02-16 09:00:44,180 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. after waiting 0 ms 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,180 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,180 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f052463a33ef1bde26e436250fff4a77: 2023-02-16 09:00:44,182 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:44,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538044183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044183"}]},"ts":"1676538044183"} 2023-02-16 09:00:44,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:44,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:44,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538044187"}]},"ts":"1676538044187"} 2023-02-16 09:00:44,188 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:44,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:44,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:44,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:44,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:44,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f052463a33ef1bde26e436250fff4a77, ASSIGN}] 2023-02-16 09:00:44,200 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f052463a33ef1bde26e436250fff4a77, ASSIGN 2023-02-16 09:00:44,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f052463a33ef1bde26e436250fff4a77, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,351 INFO [jenkins-hbase4:42815] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:44,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f052463a33ef1bde26e436250fff4a77, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538044352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044352"}]},"ts":"1676538044352"} 2023-02-16 09:00:44,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f052463a33ef1bde26e436250fff4a77, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,403 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:00:44,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36163%2C1676538043474, suffix=, logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474, archiveDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs, maxLogs=32 2023-02-16 09:00:44,537 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK] 2023-02-16 09:00:44,537 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK] 2023-02-16 09:00:44,539 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474/jenkins-hbase4.apache.org%2C36163%2C1676538043474.1676538044523 2023-02-16 09:00:44,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK], DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK]] 2023-02-16 09:00:44,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f052463a33ef1bde26e436250fff4a77, NAME => 'hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:44,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,541 INFO [StoreOpener-f052463a33ef1bde26e436250fff4a77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,542 DEBUG [StoreOpener-f052463a33ef1bde26e436250fff4a77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/info 2023-02-16 09:00:44,542 DEBUG [StoreOpener-f052463a33ef1bde26e436250fff4a77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/info 2023-02-16 09:00:44,543 INFO [StoreOpener-f052463a33ef1bde26e436250fff4a77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f052463a33ef1bde26e436250fff4a77 columnFamilyName info 2023-02-16 09:00:44,543 INFO [StoreOpener-f052463a33ef1bde26e436250fff4a77-1] regionserver.HStore(310): Store=f052463a33ef1bde26e436250fff4a77/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:44,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:44,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:44,561 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f052463a33ef1bde26e436250fff4a77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70209057, jitterRate=0.04619647562503815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:44,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f052463a33ef1bde26e436250fff4a77: 2023-02-16 09:00:44,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77., pid=6, masterSystemTime=1676538044506 2023-02-16 09:00:44,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,565 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:44,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f052463a33ef1bde26e436250fff4a77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538044565"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538044565"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538044565"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538044565"}]},"ts":"1676538044565"} 2023-02-16 09:00:44,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:44,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f052463a33ef1bde26e436250fff4a77, server=jenkins-hbase4.apache.org,36163,1676538043474 in 213 msec 2023-02-16 09:00:44,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:44,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f052463a33ef1bde26e436250fff4a77, ASSIGN in 375 msec 2023-02-16 09:00:44,570 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:44,570 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538044570"}]},"ts":"1676538044570"} 2023-02-16 09:00:44,572 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:44,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:44,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 420 msec 2023-02-16 09:00:44,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:44,657 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:44,658 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:44,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:44,681 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:44,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 22 msec 2023-02-16 09:00:44,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:44,704 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:44,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-16 09:00:44,718 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:44,721 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:44,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.183sec 2023-02-16 09:00:44,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:44,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:44,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:44,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42815,1676538043426-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:44,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42815,1676538043426-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:44,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:44,731 DEBUG [Listener at localhost/37905] zookeeper.ReadOnlyZKClient(139): Connect 0x005c7ad7 to 127.0.0.1:57407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:44,736 DEBUG [Listener at localhost/37905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fd7eb4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:44,738 DEBUG [hconnection-0x1ce1d409-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:44,741 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:44,743 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:44,743 DEBUG [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:44,744 DEBUG [Listener at localhost/37905] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:44,746 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:44,746 INFO [Listener at localhost/37905] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 09:00:44,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 09:00:44,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:44,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:60528 deadline: 1676538104747, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-16 09:00:44,747 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-16 09:00:44,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:44,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:44,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:44,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-16 09:00:44,753 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:44,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:44,759 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b empty. 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:44,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 empty. 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae empty. 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:44,761 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:44,762 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 09:00:44,771 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:44,772 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6b04deb8f8ca96911a3ed659e8e5b733, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,773 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 64c7cc6899a956553fd9eaeb86b311b5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,773 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 615726a9a6c6f0cafeab86e9d83cc775, NAME => 'testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 64c7cc6899a956553fd9eaeb86b311b5, disabling compactions & flushes 2023-02-16 09:00:44,780 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 615726a9a6c6f0cafeab86e9d83cc775, disabling compactions & flushes 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. after waiting 0 ms 2023-02-16 09:00:44,780 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:44,780 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. after waiting 0 ms 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:44,780 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:44,780 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:44,781 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 46cb0cd2ea2fd3a9d76f417c05b99736, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,781 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d26efbdad702811f9081be173fc12f1b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 6b04deb8f8ca96911a3ed659e8e5b733, disabling compactions & flushes 2023-02-16 09:00:44,781 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. after waiting 0 ms 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:44,781 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:44,781 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:44,782 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6584bf9b5b8f32601e42c1c143a39d16, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 46cb0cd2ea2fd3a9d76f417c05b99736, disabling compactions & flushes 2023-02-16 09:00:44,788 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. after waiting 0 ms 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:44,788 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:44,788 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:44,788 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 465321fabc91e7615954dc8804b23046, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,789 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,789 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 6584bf9b5b8f32601e42c1c143a39d16, disabling compactions & flushes 2023-02-16 09:00:44,789 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. after waiting 0 ms 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:44,790 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:44,790 WARN [DataStreamer for file /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:44,790 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c81406abc779d61fd932bc62cf3cd060, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing d26efbdad702811f9081be173fc12f1b, disabling compactions & flushes 2023-02-16 09:00:44,790 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:44,790 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:44,791 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. after waiting 0 ms 2023-02-16 09:00:44,791 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:44,791 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:44,791 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:44,791 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ba89d7c66a8a8c884967574e783608d0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 465321fabc91e7615954dc8804b23046, disabling compactions & flushes 2023-02-16 09:00:44,796 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. after waiting 0 ms 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:44,796 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:44,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:44,797 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 28e6c956cf96464e7ba155edeb2abdae, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c81406abc779d61fd932bc62cf3cd060, disabling compactions & flushes 2023-02-16 09:00:44,798 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. after waiting 0 ms 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,798 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ba89d7c66a8a8c884967574e783608d0, disabling compactions & flushes 2023-02-16 09:00:44,798 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:44,798 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:44,799 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. after waiting 0 ms 2023-02-16 09:00:44,799 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:44,799 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:44,799 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:44,802 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:44,803 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 28e6c956cf96464e7ba155edeb2abdae, disabling compactions & flushes 2023-02-16 09:00:44,803 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:44,803 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:44,803 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. after waiting 0 ms 2023-02-16 09:00:44,803 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:44,803 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:44,803 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:44,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:44,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538044805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538044805"}]},"ts":"1676538044805"} 2023-02-16 09:00:44,807 INFO [RS:1;jenkins-hbase4:40519] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40519%2C1676538043503, suffix=, logDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,40519,1676538043503, archiveDir=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs, maxLogs=32 2023-02-16 09:00:44,808 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 09:00:44,808 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:44,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538044808"}]},"ts":"1676538044808"} 2023-02-16 09:00:44,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-16 09:00:44,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:44,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:44,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:44,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:44,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, ASSIGN}] 2023-02-16 09:00:44,822 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, ASSIGN 2023-02-16 09:00:44,822 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, ASSIGN 2023-02-16 09:00:44,822 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, ASSIGN 2023-02-16 09:00:44,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, ASSIGN 2023-02-16 09:00:44,823 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, ASSIGN 2023-02-16 09:00:44,823 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1676538043503; forceNewPlan=false, retain=false 2023-02-16 09:00:44,823 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,823 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1676538043503; forceNewPlan=false, retain=false 2023-02-16 09:00:44,823 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1676538043503; forceNewPlan=false, retain=false 2023-02-16 09:00:44,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, ASSIGN 2023-02-16 09:00:44,825 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, ASSIGN 2023-02-16 09:00:44,825 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, ASSIGN 2023-02-16 09:00:44,825 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, ASSIGN 2023-02-16 09:00:44,825 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, ASSIGN 2023-02-16 09:00:44,825 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,825 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1676538043503; forceNewPlan=false, retain=false 2023-02-16 09:00:44,825 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,825 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1676538043503; forceNewPlan=false, retain=false 2023-02-16 09:00:44,827 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK] 2023-02-16 09:00:44,827 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK] 2023-02-16 09:00:44,828 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36163,1676538043474; forceNewPlan=false, retain=false 2023-02-16 09:00:44,829 INFO [RS:1;jenkins-hbase4:40519] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,40519,1676538043503/jenkins-hbase4.apache.org%2C40519%2C1676538043503.1676538044808 2023-02-16 09:00:44,829 DEBUG [RS:1;jenkins-hbase4:40519] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46311,DS-f37a4e8a-e2c9-4229-8feb-b8a47d6b46e6,DISK], DatanodeInfoWithStorage[127.0.0.1:36973,DS-669e3478-bb72-402d-913a-0cda4b405be2,DISK]] 2023-02-16 09:00:44,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:44,973 INFO [jenkins-hbase4:42815] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 09:00:44,979 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=28e6c956cf96464e7ba155edeb2abdae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:44,979 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=615726a9a6c6f0cafeab86e9d83cc775, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:44,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d26efbdad702811f9081be173fc12f1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:44,979 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c81406abc779d61fd932bc62cf3cd060, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:44,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044979"}]},"ts":"1676538044979"} 2023-02-16 09:00:44,979 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=46cb0cd2ea2fd3a9d76f417c05b99736, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:44,979 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044979"}]},"ts":"1676538044979"} 2023-02-16 09:00:44,980 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044979"}]},"ts":"1676538044979"} 2023-02-16 09:00:44,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538044979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044979"}]},"ts":"1676538044979"} 2023-02-16 09:00:44,979 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538044979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044979"}]},"ts":"1676538044979"} 2023-02-16 09:00:44,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure d26efbdad702811f9081be173fc12f1b, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:44,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 46cb0cd2ea2fd3a9d76f417c05b99736, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:44,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure c81406abc779d61fd932bc62cf3cd060, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:44,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 615726a9a6c6f0cafeab86e9d83cc775, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:44,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 28e6c956cf96464e7ba155edeb2abdae, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:44,984 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=64c7cc6899a956553fd9eaeb86b311b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,985 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044984"}]},"ts":"1676538044984"} 2023-02-16 09:00:44,985 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6b04deb8f8ca96911a3ed659e8e5b733, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044985"}]},"ts":"1676538044985"} 2023-02-16 09:00:44,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure 64c7cc6899a956553fd9eaeb86b311b5, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,986 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ba89d7c66a8a8c884967574e783608d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044986"}]},"ts":"1676538044986"} 2023-02-16 09:00:44,987 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=465321fabc91e7615954dc8804b23046, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 6b04deb8f8ca96911a3ed659e8e5b733, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,987 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044987"}]},"ts":"1676538044987"} 2023-02-16 09:00:44,987 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6584bf9b5b8f32601e42c1c143a39d16, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:44,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538044987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538044987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538044987"}]},"ts":"1676538044987"} 2023-02-16 09:00:44,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure ba89d7c66a8a8c884967574e783608d0, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure 465321fabc91e7615954dc8804b23046, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:44,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 6584bf9b5b8f32601e42c1c143a39d16, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:45,133 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,133 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:45,135 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45350, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:45,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28e6c956cf96464e7ba155edeb2abdae, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 09:00:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,139 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 64c7cc6899a956553fd9eaeb86b311b5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 09:00:45,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,141 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f1 2023-02-16 09:00:45,141 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f1 2023-02-16 09:00:45,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,141 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28e6c956cf96464e7ba155edeb2abdae columnFamilyName f1 2023-02-16 09:00:45,142 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(310): Store=28e6c956cf96464e7ba155edeb2abdae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,142 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,142 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,143 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f2 2023-02-16 09:00:45,143 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f2 2023-02-16 09:00:45,143 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1 2023-02-16 09:00:45,143 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1 2023-02-16 09:00:45,143 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28e6c956cf96464e7ba155edeb2abdae columnFamilyName f2 2023-02-16 09:00:45,143 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64c7cc6899a956553fd9eaeb86b311b5 columnFamilyName f1 2023-02-16 09:00:45,144 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(310): Store=28e6c956cf96464e7ba155edeb2abdae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,144 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(310): Store=64c7cc6899a956553fd9eaeb86b311b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,144 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,145 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2 2023-02-16 09:00:45,145 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2 2023-02-16 09:00:45,146 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64c7cc6899a956553fd9eaeb86b311b5 columnFamilyName f2 2023-02-16 09:00:45,146 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(310): Store=64c7cc6899a956553fd9eaeb86b311b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:45,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:45,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 28e6c956cf96464e7ba155edeb2abdae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66883648, jitterRate=-0.0033559799194335938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:45,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae., pid=25, masterSystemTime=1676538045133 2023-02-16 09:00:45,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 64c7cc6899a956553fd9eaeb86b311b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59915438, jitterRate=-0.10719040036201477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:45,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:45,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:45,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:45,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 615726a9a6c6f0cafeab86e9d83cc775, NAME => 'testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 09:00:45,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=28e6c956cf96464e7ba155edeb2abdae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5., pid=26, masterSystemTime=1676538045138 2023-02-16 09:00:45,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,155 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538045155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045155"}]},"ts":"1676538045155"} 2023-02-16 09:00:45,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,156 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:45,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba89d7c66a8a8c884967574e783608d0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 09:00:45,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=64c7cc6899a956553fd9eaeb86b311b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045157"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045157"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045157"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045157"}]},"ts":"1676538045157"} 2023-02-16 09:00:45,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,158 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f1 2023-02-16 09:00:45,158 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f1 2023-02-16 09:00:45,158 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,158 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 615726a9a6c6f0cafeab86e9d83cc775 columnFamilyName f1 2023-02-16 09:00:45,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-16 09:00:45,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 28e6c956cf96464e7ba155edeb2abdae, server=jenkins-hbase4.apache.org,40519,1676538043503 in 172 msec 2023-02-16 09:00:45,159 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(310): Store=615726a9a6c6f0cafeab86e9d83cc775/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,159 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,160 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1 2023-02-16 09:00:45,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, ASSIGN in 341 msec 2023-02-16 09:00:45,160 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1 2023-02-16 09:00:45,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-16 09:00:45,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure 64c7cc6899a956553fd9eaeb86b311b5, server=jenkins-hbase4.apache.org,36163,1676538043474 in 172 msec 2023-02-16 09:00:45,160 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba89d7c66a8a8c884967574e783608d0 columnFamilyName f1 2023-02-16 09:00:45,161 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(310): Store=ba89d7c66a8a8c884967574e783608d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,161 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f2 2023-02-16 09:00:45,161 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,161 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f2 2023-02-16 09:00:45,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, ASSIGN in 342 msec 2023-02-16 09:00:45,161 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 615726a9a6c6f0cafeab86e9d83cc775 columnFamilyName f2 2023-02-16 09:00:45,162 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(310): Store=615726a9a6c6f0cafeab86e9d83cc775/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,162 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2 2023-02-16 09:00:45,162 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2 2023-02-16 09:00:45,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,162 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba89d7c66a8a8c884967574e783608d0 columnFamilyName f2 2023-02-16 09:00:45,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,163 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(310): Store=ba89d7c66a8a8c884967574e783608d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:45,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:45,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 615726a9a6c6f0cafeab86e9d83cc775; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72252311, jitterRate=0.07664333283901215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:45,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775., pid=24, masterSystemTime=1676538045133 2023-02-16 09:00:45,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ba89d7c66a8a8c884967574e783608d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58879801, jitterRate=-0.12262259423732758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:45,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:45,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:45,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:45,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d26efbdad702811f9081be173fc12f1b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 09:00:45,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0., pid=28, masterSystemTime=1676538045138 2023-02-16 09:00:45,170 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=615726a9a6c6f0cafeab86e9d83cc775, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,170 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538045170"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045170"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045170"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045170"}]},"ts":"1676538045170"} 2023-02-16 09:00:45,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:45,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:45,171 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:45,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 465321fabc91e7615954dc8804b23046, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 09:00:45,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,172 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ba89d7c66a8a8c884967574e783608d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,172 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045172"}]},"ts":"1676538045172"} 2023-02-16 09:00:45,173 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,174 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1 2023-02-16 09:00:45,174 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1 2023-02-16 09:00:45,174 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26efbdad702811f9081be173fc12f1b columnFamilyName f1 2023-02-16 09:00:45,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-16 09:00:45,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 615726a9a6c6f0cafeab86e9d83cc775, server=jenkins-hbase4.apache.org,40519,1676538043503 in 187 msec 2023-02-16 09:00:45,174 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(310): Store=d26efbdad702811f9081be173fc12f1b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,175 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,175 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1 2023-02-16 09:00:45,175 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1 2023-02-16 09:00:45,175 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 465321fabc91e7615954dc8804b23046 columnFamilyName f1 2023-02-16 09:00:45,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, ASSIGN in 356 msec 2023-02-16 09:00:45,176 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(310): Store=465321fabc91e7615954dc8804b23046/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,176 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,176 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2 2023-02-16 09:00:45,176 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2 2023-02-16 09:00:45,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-16 09:00:45,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure ba89d7c66a8a8c884967574e783608d0, server=jenkins-hbase4.apache.org,36163,1676538043474 in 187 msec 2023-02-16 09:00:45,176 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26efbdad702811f9081be173fc12f1b columnFamilyName f2 2023-02-16 09:00:45,177 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2 2023-02-16 09:00:45,177 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2 2023-02-16 09:00:45,177 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 465321fabc91e7615954dc8804b23046 columnFamilyName f2 2023-02-16 09:00:45,178 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(310): Store=d26efbdad702811f9081be173fc12f1b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,178 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(310): Store=465321fabc91e7615954dc8804b23046/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, ASSIGN in 358 msec 2023-02-16 09:00:45,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:45,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:45,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d26efbdad702811f9081be173fc12f1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71461208, jitterRate=0.06485497951507568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:45,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b., pid=21, masterSystemTime=1676538045133 2023-02-16 09:00:45,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 465321fabc91e7615954dc8804b23046; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64277111, jitterRate=-0.04219640791416168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:45,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:45,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:45,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046., pid=29, masterSystemTime=1676538045138 2023-02-16 09:00:45,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 46cb0cd2ea2fd3a9d76f417c05b99736, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 09:00:45,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d26efbdad702811f9081be173fc12f1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,187 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045186"}]},"ts":"1676538045186"} 2023-02-16 09:00:45,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:45,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:45,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:45,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b04deb8f8ca96911a3ed659e8e5b733, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 09:00:45,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=465321fabc91e7615954dc8804b23046, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045188"}]},"ts":"1676538045188"} 2023-02-16 09:00:45,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,189 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-16 09:00:45,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure d26efbdad702811f9081be173fc12f1b, server=jenkins-hbase4.apache.org,40519,1676538043503 in 207 msec 2023-02-16 09:00:45,191 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, ASSIGN in 372 msec 2023-02-16 09:00:45,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-16 09:00:45,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure 465321fabc91e7615954dc8804b23046, server=jenkins-hbase4.apache.org,36163,1676538043474 in 202 msec 2023-02-16 09:00:45,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, ASSIGN in 374 msec 2023-02-16 09:00:45,194 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1 2023-02-16 09:00:45,194 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1 2023-02-16 09:00:45,194 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cb0cd2ea2fd3a9d76f417c05b99736 columnFamilyName f1 2023-02-16 09:00:45,194 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(310): Store=46cb0cd2ea2fd3a9d76f417c05b99736/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,194 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,196 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2 2023-02-16 09:00:45,196 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2 2023-02-16 09:00:45,196 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cb0cd2ea2fd3a9d76f417c05b99736 columnFamilyName f2 2023-02-16 09:00:45,197 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(310): Store=46cb0cd2ea2fd3a9d76f417c05b99736/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,200 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1 2023-02-16 09:00:45,200 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1 2023-02-16 09:00:45,201 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b04deb8f8ca96911a3ed659e8e5b733 columnFamilyName f1 2023-02-16 09:00:45,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:45,201 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(310): Store=6b04deb8f8ca96911a3ed659e8e5b733/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,201 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,202 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2 2023-02-16 09:00:45,203 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2 2023-02-16 09:00:45,203 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b04deb8f8ca96911a3ed659e8e5b733 columnFamilyName f2 2023-02-16 09:00:45,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,204 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(310): Store=6b04deb8f8ca96911a3ed659e8e5b733/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 46cb0cd2ea2fd3a9d76f417c05b99736; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67202707, jitterRate=0.0013983696699142456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:45,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:45,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736., pid=22, masterSystemTime=1676538045133 2023-02-16 09:00:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c81406abc779d61fd932bc62cf3cd060, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 09:00:45,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=46cb0cd2ea2fd3a9d76f417c05b99736, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045210"}]},"ts":"1676538045210"} 2023-02-16 09:00:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,213 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6b04deb8f8ca96911a3ed659e8e5b733; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59734102, jitterRate=-0.10989251732826233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:45,214 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1 2023-02-16 09:00:45,215 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1 2023-02-16 09:00:45,215 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81406abc779d61fd932bc62cf3cd060 columnFamilyName f1 2023-02-16 09:00:45,215 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(310): Store=c81406abc779d61fd932bc62cf3cd060/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,216 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-16 09:00:45,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733., pid=27, masterSystemTime=1676538045138 2023-02-16 09:00:45,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 46cb0cd2ea2fd3a9d76f417c05b99736, server=jenkins-hbase4.apache.org,40519,1676538043503 in 230 msec 2023-02-16 09:00:45,217 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2 2023-02-16 09:00:45,217 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2 2023-02-16 09:00:45,218 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81406abc779d61fd932bc62cf3cd060 columnFamilyName f2 2023-02-16 09:00:45,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:45,218 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(310): Store=c81406abc779d61fd932bc62cf3cd060/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:45,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:45,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6584bf9b5b8f32601e42c1c143a39d16, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 09:00:45,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, ASSIGN in 398 msec 2023-02-16 09:00:45,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6b04deb8f8ca96911a3ed659e8e5b733, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045219"}]},"ts":"1676538045219"} 2023-02-16 09:00:45,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:45,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,222 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-16 09:00:45,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 6b04deb8f8ca96911a3ed659e8e5b733, server=jenkins-hbase4.apache.org,36163,1676538043474 in 234 msec 2023-02-16 09:00:45,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,223 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1 2023-02-16 09:00:45,223 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1 2023-02-16 09:00:45,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, ASSIGN in 405 msec 2023-02-16 09:00:45,224 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6584bf9b5b8f32601e42c1c143a39d16 columnFamilyName f1 2023-02-16 09:00:45,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:45,225 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(310): Store=6584bf9b5b8f32601e42c1c143a39d16/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,225 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,226 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2 2023-02-16 09:00:45,226 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2 2023-02-16 09:00:45,226 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6584bf9b5b8f32601e42c1c143a39d16 columnFamilyName f2 2023-02-16 09:00:45,227 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(310): Store=6584bf9b5b8f32601e42c1c143a39d16/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:45,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c81406abc779d61fd932bc62cf3cd060; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65862349, jitterRate=-0.01857452094554901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:45,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060., pid=23, masterSystemTime=1676538045133 2023-02-16 09:00:45,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:45,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:45,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:45,231 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c81406abc779d61fd932bc62cf3cd060, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,231 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045231"}]},"ts":"1676538045231"} 2023-02-16 09:00:45,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:45,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:45,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-16 09:00:45,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure c81406abc779d61fd932bc62cf3cd060, server=jenkins-hbase4.apache.org,40519,1676538043503 in 251 msec 2023-02-16 09:00:45,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6584bf9b5b8f32601e42c1c143a39d16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70393142, jitterRate=0.04893955588340759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:45,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:45,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, ASSIGN in 416 msec 2023-02-16 09:00:45,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16., pid=30, masterSystemTime=1676538045138 2023-02-16 09:00:45,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:45,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:45,237 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6584bf9b5b8f32601e42c1c143a39d16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,237 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538045237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538045237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538045237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538045237"}]},"ts":"1676538045237"} 2023-02-16 09:00:45,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-16 09:00:45,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 6584bf9b5b8f32601e42c1c143a39d16, server=jenkins-hbase4.apache.org,36163,1676538043474 in 250 msec 2023-02-16 09:00:45,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-16 09:00:45,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, ASSIGN in 422 msec 2023-02-16 09:00:45,242 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:45,242 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538045242"}]},"ts":"1676538045242"} 2023-02-16 09:00:45,243 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-16 09:00:45,246 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:45,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 497 msec 2023-02-16 09:00:45,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:45,357 INFO [Listener at localhost/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-16 09:00:45,358 DEBUG [Listener at localhost/37905] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-16 09:00:45,358 INFO [Listener at localhost/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:45,360 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-16 09:00:45,360 INFO [Listener at localhost/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:45,360 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-16 09:00:45,360 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:45,392 DEBUG [hconnection-0x1ce1d409-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:45,401 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45356, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:45,406 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,414 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36163] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,534 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:45,534 INFO [Listener at localhost/37905] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:45,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 09:00:45,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538045535 (current time:1676538045535). 2023-02-16 09:00:45,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:45,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] zookeeper.ReadOnlyZKClient(139): Connect 0x3e3b6dc5 to 127.0.0.1:57407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:45,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@134999c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:45,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:45,543 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:45,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e3b6dc5 to 127.0.0.1:57407 2023-02-16 09:00:45,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:45,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:45,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 09:00:45,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 09:00:45,548 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 09:00:45,549 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676538645548 2023-02-16 09:00:45,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 09:00:45,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,550 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:45,550 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:45,550 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 09:00:45,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 09:00:45,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-16 09:00:45,552 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 09:00:45,552 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676538645552 2023-02-16 09:00:45,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,563 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 09:00:45,563 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:45,564 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 09:00:45,564 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 09:00:45,564 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,564 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,566 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,566 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:45,566 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:45,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:45,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:45,567 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,567 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,567 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,567 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 09:00:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1676538043503' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 09:00:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36163,1676538043474' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 09:00:45,574 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,574 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:45,575 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,575 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,575 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,575 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:45,575 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,575 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1676538043503' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41ec2aad[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:45,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36163,1676538043474' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 09:00:45,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41ec2aad[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:45,579 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 09:00:45,579 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,579 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,580 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:45,580 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:45,580 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,580 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:45,580 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. started... 2023-02-16 09:00:45,580 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,580 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:45,582 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6b04deb8f8ca96911a3ed659e8e5b733 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. started... 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. started... 2023-02-16 09:00:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:45,583 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:45,583 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 64c7cc6899a956553fd9eaeb86b311b5 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. started... 2023-02-16 09:00:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 09:00:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:45,584 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:45,583 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:45,583 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. started... 2023-02-16 09:00:45,583 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:45,585 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d26efbdad702811f9081be173fc12f1b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,582 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:45,585 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,584 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,585 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,586 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:45,586 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:45,585 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. started... 2023-02-16 09:00:45,586 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,586 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:45,586 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 09:00:45,587 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 465321fabc91e7615954dc8804b23046 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. completed. 2023-02-16 09:00:45,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:45,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:45,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. started... 2023-02-16 09:00:45,601 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c81406abc779d61fd932bc62cf3cd060 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:45,609 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f1/d9fea1ac5ce741d68102d0185ca09cda 2023-02-16 09:00:45,619 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f1/4595eea05a8f42cd9ec1fe9682326564 2023-02-16 09:00:45,619 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. completed. 2023-02-16 09:00:45,619 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:45,619 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,619 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. started... 2023-02-16 09:00:45,619 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:45,620 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 46cb0cd2ea2fd3a9d76f417c05b99736 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,620 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f1/2f686ce58f654db2ab72ffd2b88f304c 2023-02-16 09:00:45,621 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f1/3382a2dcbd194b9b830d21fd15290794 2023-02-16 09:00:45,650 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:45,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:45,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:45,652 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:45,657 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f1/66df758de15f4192b880b76cc18e6c71 2023-02-16 09:00:45,662 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f1/974daa9098954e148b3db2acb017b4a4 2023-02-16 09:00:45,669 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f2/b1a4376e0e554567bc57106a1e594475 2023-02-16 09:00:45,669 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f2/c9a75af9d1354743a39134c315c08679 2023-02-16 09:00:45,670 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca 2023-02-16 09:00:45,677 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f1/d9fea1ac5ce741d68102d0185ca09cda as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda 2023-02-16 09:00:45,678 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f1/2f686ce58f654db2ab72ffd2b88f304c as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c 2023-02-16 09:00:45,680 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f1/3382a2dcbd194b9b830d21fd15290794 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794 2023-02-16 09:00:45,682 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,683 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f2/b1a4376e0e554567bc57106a1e594475 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475 2023-02-16 09:00:45,683 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,684 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f2/c9a75af9d1354743a39134c315c08679 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679 2023-02-16 09:00:45,685 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:45,686 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f2/0c31ccbbc555453296473f05e0220d51 2023-02-16 09:00:45,688 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca 2023-02-16 09:00:45,688 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f2/51ac832b4dc54e8d9686b538cdd3c52a 2023-02-16 09:00:45,690 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,691 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6b04deb8f8ca96911a3ed659e8e5b733 in 109ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,691 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 09:00:45,692 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,692 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:45,692 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,693 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,694 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda] hfiles 2023-02-16 09:00:45,694 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,694 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475] hfiles 2023-02-16 09:00:45,694 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,694 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d26efbdad702811f9081be173fc12f1b in 109ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,695 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:45,695 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,696 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,696 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c] hfiles 2023-02-16 09:00:45,696 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,696 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679] hfiles 2023-02-16 09:00:45,696 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,697 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:45,697 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f1/66df758de15f4192b880b76cc18e6c71 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71 2023-02-16 09:00:45,698 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 64c7cc6899a956553fd9eaeb86b311b5 in 115ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794] hfiles 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca] hfiles 2023-02-16 09:00:45,698 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,699 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f1/974daa9098954e148b3db2acb017b4a4 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4 2023-02-16 09:00:45,703 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,703 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f2/0c31ccbbc555453296473f05e0220d51 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51 2023-02-16 09:00:45,712 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. completed. 2023-02-16 09:00:45,712 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:45,712 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 09:00:45,712 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. started... 2023-02-16 09:00:45,714 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,715 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f2/51ac832b4dc54e8d9686b538cdd3c52a as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a 2023-02-16 09:00:45,716 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. completed. 2023-02-16 09:00:45,716 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:45,716 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:45,721 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6584bf9b5b8f32601e42c1c143a39d16 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 09:00:45,722 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,723 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c81406abc779d61fd932bc62cf3cd060 in 121ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,723 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71] hfiles 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51] hfiles 2023-02-16 09:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,724 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 46cb0cd2ea2fd3a9d76f417c05b99736 in 104ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4] hfiles 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a] hfiles 2023-02-16 09:00:45,724 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,730 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. completed. 2023-02-16 09:00:45,730 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:45,730 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 09:00:45,730 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. started... 2023-02-16 09:00:45,731 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ba89d7c66a8a8c884967574e783608d0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 09:00:45,737 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. completed. 2023-02-16 09:00:45,737 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:45,738 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:45,744 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. completed. 2023-02-16 09:00:45,744 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 09:00:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40519,1676538043503' in zk 2023-02-16 09:00:45,747 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f1/57342b6eb9e5488ea73ae1e0233dc19b 2023-02-16 09:00:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:45,747 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 09:00:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,752 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f1/86f8bd1db6b24ffd9a7999e96eb9422c 2023-02-16 09:00:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40519,1676538043503': 2023-02-16 09:00:45,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1676538043503' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 09:00:45,764 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 2023-02-16 09:00:45,767 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f2/9f5fda725269443292195b5b933aa9a7 2023-02-16 09:00:45,769 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f1/57342b6eb9e5488ea73ae1e0233dc19b as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b 2023-02-16 09:00:45,771 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f1/86f8bd1db6b24ffd9a7999e96eb9422c as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c 2023-02-16 09:00:45,773 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,774 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 2023-02-16 09:00:45,775 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:45,777 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f2/9f5fda725269443292195b5b933aa9a7 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7 2023-02-16 09:00:45,779 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:45,780 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6584bf9b5b8f32601e42c1c143a39d16 in 59ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b] hfiles 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7] hfiles 2023-02-16 09:00:45,781 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,782 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 09:00:45,783 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ba89d7c66a8a8c884967574e783608d0 in 52ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:45,783 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:45,783 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,783 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:45,784 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c] hfiles 2023-02-16 09:00:45,784 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,784 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7] hfiles 2023-02-16 09:00:45,784 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:45,800 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. completed. 2023-02-16 09:00:45,801 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:45,801 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. completed. 2023-02-16 09:00:45,801 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 09:00:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 09:00:45,852 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:45,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:45,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:45,854 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 09:00:46,077 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f2/bac9362e49b7465090e8f997b2aeb68b 2023-02-16 09:00:46,083 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f1/4595eea05a8f42cd9ec1fe9682326564 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564 2023-02-16 09:00:46,087 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:46,087 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f2/bac9362e49b7465090e8f997b2aeb68b as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b 2023-02-16 09:00:46,091 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 09:00:46,091 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 465321fabc91e7615954dc8804b23046 in 505ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:46,091 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:46,091 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,092 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:46,092 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564] hfiles 2023-02-16 09:00:46,092 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,092 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b] hfiles 2023-02-16 09:00:46,092 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,098 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. completed. 2023-02-16 09:00:46,098 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:46,098 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 09:00:46,098 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 09:00:46,098 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,098 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 09:00:46,098 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36163,1676538043474' in zk 2023-02-16 09:00:46,100 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 09:00:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36163,1676538043474': 2023-02-16 09:00:46,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36163,1676538043474' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:46,103 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 09:00:46,103 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:46,103 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:46,103 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,103 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:46,105 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:46,105 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:46,105 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:46,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:46,106 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:46,106 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,108 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:46,108 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:46,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:46,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:46,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,154 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:46,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:46,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:46,156 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 09:00:46,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-16 09:00:46,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,188 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676538045549Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676538046114 (+565 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676538046114Writing data manifest for testWithMockedMapReduceMultiRegion at 1676538046120 (+6 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676538046132 (+12 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676538046187 (+55 ms) 2023-02-16 09:00:46,190 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 09:00:46,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 641 msec 2023-02-16 09:00:46,656 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:46,658 INFO [Listener at localhost/37905] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:46,663 INFO [Listener at localhost/37905] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:46,673 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:46,693 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:46,700 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36163] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:46,769 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:46,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:46,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,778 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 09:00:46,778 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:46,779 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 09:00:46,779 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 09:00:46,779 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,779 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,833 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:46,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:46,834 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,834 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:46,834 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:46,835 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:46,835 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,835 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:46,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:46,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 09:00:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:46,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:46,838 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,838 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. started... 2023-02-16 09:00:46,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,838 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:46,838 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6b04deb8f8ca96911a3ed659e8e5b733 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:46,838 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. started... 2023-02-16 09:00:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:46,839 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. started... 2023-02-16 09:00:46,839 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 465321fabc91e7615954dc8804b23046 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:46,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:46,839 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 64c7cc6899a956553fd9eaeb86b311b5 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 09:00:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 09:00:46,843 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:46,843 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. started... 2023-02-16 09:00:46,843 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:46,843 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:46,844 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:46,844 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. started... 2023-02-16 09:00:46,844 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:46,844 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:46,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 09:00:46,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:46,848 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:46,848 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. started... 2023-02-16 09:00:46,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:46,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:46,848 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d26efbdad702811f9081be173fc12f1b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:46,856 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:46,857 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. started... 2023-02-16 09:00:46,858 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c81406abc779d61fd932bc62cf3cd060 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:46,856 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:46,858 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. started... 2023-02-16 09:00:46,859 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 46cb0cd2ea2fd3a9d76f417c05b99736 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:46,919 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f1/aa398149612e43038c0198881e693fb7 2023-02-16 09:00:46,940 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f1/a5657a0a4fc64afebfb8400c934abc71 2023-02-16 09:00:46,940 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f1/759c29d6fbeb4cf98adb25b01e3e752e 2023-02-16 09:00:46,944 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f1/ae2e967a140a4aa5be721d4c864a707d 2023-02-16 09:00:46,962 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f1/79f4439e4fbd4f8b97ecdcba5ec91cce 2023-02-16 09:00:46,964 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1 2023-02-16 09:00:47,000 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f2/8b3bad3026d54e978695d472e1db7e94 2023-02-16 09:00:47,005 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f2/ad2f8203e317496c98ab9b6f795582c3 2023-02-16 09:00:47,007 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f1/759c29d6fbeb4cf98adb25b01e3e752e as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/759c29d6fbeb4cf98adb25b01e3e752e 2023-02-16 09:00:47,014 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f1/aa398149612e43038c0198881e693fb7 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/aa398149612e43038c0198881e693fb7 2023-02-16 09:00:47,015 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/759c29d6fbeb4cf98adb25b01e3e752e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,017 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/.tmp/f2/8b3bad3026d54e978695d472e1db7e94 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/8b3bad3026d54e978695d472e1db7e94 2023-02-16 09:00:47,020 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/aa398149612e43038c0198881e693fb7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:47,022 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/.tmp/f2/ad2f8203e317496c98ab9b6f795582c3 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/ad2f8203e317496c98ab9b6f795582c3 2023-02-16 09:00:47,023 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f2/ea1589772cca4211aa30e5f08e7ba051 2023-02-16 09:00:47,026 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f2/b762343cdd634509a0cbd37fdd9c38db 2023-02-16 09:00:47,028 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/ad2f8203e317496c98ab9b6f795582c3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:47,030 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f1/a5657a0a4fc64afebfb8400c934abc71 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/a5657a0a4fc64afebfb8400c934abc71 2023-02-16 09:00:47,032 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/8b3bad3026d54e978695d472e1db7e94, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,032 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 64c7cc6899a956553fd9eaeb86b311b5 in 193ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,033 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6b04deb8f8ca96911a3ed659e8e5b733 in 195ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,033 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:47,033 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:47,033 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f2/c9b77a0e047e4ff793f0cc929f0dfbbe 2023-02-16 09:00:47,033 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,033 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. started... 2023-02-16 09:00:47,033 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 09:00:47,033 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6584bf9b5b8f32601e42c1c143a39d16 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 09:00:47,034 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:47,034 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 09:00:47,034 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,034 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. started... 2023-02-16 09:00:47,034 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ba89d7c66a8a8c884967574e783608d0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 09:00:47,037 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/a5657a0a4fc64afebfb8400c934abc71, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,040 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/.tmp/f2/ea1589772cca4211aa30e5f08e7ba051 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/ea1589772cca4211aa30e5f08e7ba051 2023-02-16 09:00:47,040 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f2/a0986fa5bed84d5fa0edec6ade281816 2023-02-16 09:00:47,042 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f1/ae2e967a140a4aa5be721d4c864a707d as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/ae2e967a140a4aa5be721d4c864a707d 2023-02-16 09:00:47,045 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1 2023-02-16 09:00:47,049 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/ae2e967a140a4aa5be721d4c864a707d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,051 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/.tmp/f2/b762343cdd634509a0cbd37fdd9c38db as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/b762343cdd634509a0cbd37fdd9c38db 2023-02-16 09:00:47,051 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,052 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f1/79f4439e4fbd4f8b97ecdcba5ec91cce as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/79f4439e4fbd4f8b97ecdcba5ec91cce 2023-02-16 09:00:47,053 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/.tmp/f2/c9b77a0e047e4ff793f0cc929f0dfbbe as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/c9b77a0e047e4ff793f0cc929f0dfbbe 2023-02-16 09:00:47,053 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/ea1589772cca4211aa30e5f08e7ba051, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,055 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 465321fabc91e7615954dc8804b23046 in 216ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,055 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:47,055 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:47,074 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/79f4439e4fbd4f8b97ecdcba5ec91cce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,075 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/.tmp/f2/a0986fa5bed84d5fa0edec6ade281816 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/a0986fa5bed84d5fa0edec6ade281816 2023-02-16 09:00:47,080 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/a0986fa5bed84d5fa0edec6ade281816, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,081 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 46cb0cd2ea2fd3a9d76f417c05b99736 in 223ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,081 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:47,081 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:47,084 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 09:00:47,085 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/b762343cdd634509a0cbd37fdd9c38db, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,086 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d26efbdad702811f9081be173fc12f1b in 238ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,086 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:47,086 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:47,086 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:47,088 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f1/7f09cb6c2043484c922997c95f7398af 2023-02-16 09:00:47,090 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/c9b77a0e047e4ff793f0cc929f0dfbbe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,092 INFO [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c81406abc779d61fd932bc62cf3cd060 in 234ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,092 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:47,092 DEBUG [rs(jenkins-hbase4.apache.org,40519,1676538043503)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 09:00:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1676538043503' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 09:00:47,096 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f1/aec6949e490044cc9e668eeba68c537a 2023-02-16 09:00:47,116 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f2/5f3241e6a0ee409cbc150e94e87c7380 2023-02-16 09:00:47,117 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f2/7fea1906220a41b080ea9f509b4893ad 2023-02-16 09:00:47,122 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f1/7f09cb6c2043484c922997c95f7398af as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/7f09cb6c2043484c922997c95f7398af 2023-02-16 09:00:47,122 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f1/aec6949e490044cc9e668eeba68c537a as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/aec6949e490044cc9e668eeba68c537a 2023-02-16 09:00:47,126 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/7f09cb6c2043484c922997c95f7398af, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,127 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/.tmp/f2/5f3241e6a0ee409cbc150e94e87c7380 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/5f3241e6a0ee409cbc150e94e87c7380 2023-02-16 09:00:47,130 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/aec6949e490044cc9e668eeba68c537a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:47,130 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/.tmp/f2/7fea1906220a41b080ea9f509b4893ad as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/7fea1906220a41b080ea9f509b4893ad 2023-02-16 09:00:47,131 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/5f3241e6a0ee409cbc150e94e87c7380, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 09:00:47,132 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6584bf9b5b8f32601e42c1c143a39d16 in 98ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,132 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:47,132 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 09:00:47,134 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/7fea1906220a41b080ea9f509b4893ad, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 09:00:47,135 INFO [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ba89d7c66a8a8c884967574e783608d0 in 101ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:47,135 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:47,135 DEBUG [rs(jenkins-hbase4.apache.org,36163,1676538043474)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 09:00:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 09:00:47,136 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,136 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 09:00:47,136 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36163,1676538043474' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 09:00:47,155 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,155 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:47,201 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1676538043503' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d3a648[Count = 1] remaining members to acquire global barrier 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:47,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36163,1676538043474' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 09:00:47,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d3a648[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:47,205 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 09:00:47,206 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 09:00:47,263 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 09:00:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 09:00:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40519,1676538043503' in zk 2023-02-16 09:00:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36163,1676538043474' in zk 2023-02-16 09:00:47,264 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,264 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 09:00:47,317 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,36163,1676538043474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 09:00:47,317 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1676538043503' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 09:00:47,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:47,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:47,317 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:47,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:47,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40519,1676538043503': 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1676538043503' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36163,1676538043474': 2023-02-16 09:00:47,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36163,1676538043474' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:47,323 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 09:00:47,323 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:47,323 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:47,323 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,323 INFO [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:47,347 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,347 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:47,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,347 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:47,347 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,348 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:47,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:47,348 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,349 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,350 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:47,350 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:47,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:47,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:47,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:47,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-16 09:00:47,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:47,440 DEBUG [(jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:47,440 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:47,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,441 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,541 DEBUG [Listener at localhost/37905] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:47,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676538045535 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:47,547 DEBUG [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:47,547 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(239): region to add: 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=6b04deb8f8ca96911a3ed659e8e5b733 as 6b04deb8f8ca96911a3ed659e8e5b733 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=615726a9a6c6f0cafeab86e9d83cc775 as 615726a9a6c6f0cafeab86e9d83cc775 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=64c7cc6899a956553fd9eaeb86b311b5 as 64c7cc6899a956553fd9eaeb86b311b5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=465321fabc91e7615954dc8804b23046 as 465321fabc91e7615954dc8804b23046 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=28e6c956cf96464e7ba155edeb2abdae as 28e6c956cf96464e7ba155edeb2abdae in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=6584bf9b5b8f32601e42c1c143a39d16 as 6584bf9b5b8f32601e42c1c143a39d16 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=d26efbdad702811f9081be173fc12f1b as d26efbdad702811f9081be173fc12f1b in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=ba89d7c66a8a8c884967574e783608d0 as ba89d7c66a8a8c884967574e783608d0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=c81406abc779d61fd932bc62cf3cd060 as c81406abc779d61fd932bc62cf3cd060 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,548 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(585): clone region=46cb0cd2ea2fd3a9d76f417c05b99736 as 46cb0cd2ea2fd3a9d76f417c05b99736 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,549 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6b04deb8f8ca96911a3ed659e8e5b733, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,549 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 64c7cc6899a956553fd9eaeb86b311b5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,550 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 465321fabc91e7615954dc8804b23046, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,550 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 28e6c956cf96464e7ba155edeb2abdae, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,550 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 615726a9a6c6f0cafeab86e9d83cc775, NAME => 'testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,550 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ba89d7c66a8a8c884967574e783608d0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,550 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d26efbdad702811f9081be173fc12f1b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,551 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6584bf9b5b8f32601e42c1c143a39d16, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,580 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,580 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,580 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86f8bd1db6b24ffd9a7999e96eb9422c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,580 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,581 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 28e6c956cf96464e7ba155edeb2abdae, disabling compactions & flushes 2023-02-16 09:00:47,581 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:47,581 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:47,581 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. after waiting 0 ms 2023-02-16 09:00:47,581 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:47,581 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:47,581 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:47,582 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c81406abc779d61fd932bc62cf3cd060, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,580 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 57342b6eb9e5488ea73ae1e0233dc19b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,582 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,582 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3382a2dcbd194b9b830d21fd15290794 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,582 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,582 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,582 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 615726a9a6c6f0cafeab86e9d83cc775, disabling compactions & flushes 2023-02-16 09:00:47,582 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4595eea05a8f42cd9ec1fe9682326564 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,582 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:47,583 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:47,583 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. after waiting 0 ms 2023-02-16 09:00:47,583 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:47,583 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:47,583 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:47,583 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 46cb0cd2ea2fd3a9d76f417c05b99736, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,584 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9f5fda725269443292195b5b933aa9a7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,588 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dcea3dcf1dad44dc8f32d4d8ebd361d7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ba89d7c66a8a8c884967574e783608d0, disabling compactions & flushes 2023-02-16 09:00:47,588 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,589 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,589 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. after waiting 0 ms 2023-02-16 09:00:47,589 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,589 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:47,589 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:47,589 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 926ca2c1b9a5445aa0e4d3a91b2e55ca from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,589 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bac9362e49b7465090e8f997b2aeb68b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6584bf9b5b8f32601e42c1c143a39d16, disabling compactions & flushes 2023-02-16 09:00:47,591 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. after waiting 0 ms 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 64c7cc6899a956553fd9eaeb86b311b5, disabling compactions & flushes 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,591 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:47,591 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 465321fabc91e7615954dc8804b23046, disabling compactions & flushes 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:47,591 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. after waiting 0 ms 2023-02-16 09:00:47,591 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:47,592 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. after waiting 0 ms 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:47,592 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:47,592 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:47,596 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,596 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f686ce58f654db2ab72ffd2b88f304c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,598 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9a75af9d1354743a39134c315c08679 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,601 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 974daa9098954e148b3db2acb017b4a4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d26efbdad702811f9081be173fc12f1b, disabling compactions & flushes 2023-02-16 09:00:47,601 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. after waiting 0 ms 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:47,601 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:47,601 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,601 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66df758de15f4192b880b76cc18e6c71 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,603 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:47,603 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51ac832b4dc54e8d9686b538cdd3c52a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,603 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9fea1ac5ce741d68102d0185ca09cda from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,604 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c31ccbbc555453296473f05e0220d51 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 46cb0cd2ea2fd3a9d76f417c05b99736, disabling compactions & flushes 2023-02-16 09:00:47,605 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1a4376e0e554567bc57106a1e594475 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:47,605 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:47,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:47,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. after waiting 0 ms 2023-02-16 09:00:47,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:47,605 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:47,605 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:47,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c81406abc779d61fd932bc62cf3cd060, disabling compactions & flushes 2023-02-16 09:00:47,606 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:47,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:47,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. after waiting 0 ms 2023-02-16 09:00:47,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:47,606 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:47,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:47,607 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6b04deb8f8ca96911a3ed659e8e5b733, disabling compactions & flushes 2023-02-16 09:00:47,607 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:47,607 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:47,607 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. after waiting 0 ms 2023-02-16 09:00:47,607 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:47,607 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:47,607 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:47,607 INFO [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676538045535 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:47,608 DEBUG [Listener at localhost/37905] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,608 DEBUG [Listener at localhost/37905] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f 2023-02-16 09:00:47,608 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:47,608 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:47,609 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-16 09:00:47,609 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------28e6c956cf96464e7ba155edeb2abdae/ 2023-02-16 09:00:47,609 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,610 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------465321fabc91e7615954dc8804b23046/ 2023-02-16 09:00:47,610 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,610 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,610 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=465321fabc91e7615954dc8804b23046-4595eea05a8f42cd9ec1fe9682326564 2023-02-16 09:00:47,610 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=465321fabc91e7615954dc8804b23046-bac9362e49b7465090e8f997b2aeb68b 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------46cb0cd2ea2fd3a9d76f417c05b99736/ 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=46cb0cd2ea2fd3a9d76f417c05b99736-974daa9098954e148b3db2acb017b4a4 2023-02-16 09:00:47,611 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=46cb0cd2ea2fd3a9d76f417c05b99736-51ac832b4dc54e8d9686b538cdd3c52a 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------615726a9a6c6f0cafeab86e9d83cc775/ 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------64c7cc6899a956553fd9eaeb86b311b5/ 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,612 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=64c7cc6899a956553fd9eaeb86b311b5-3382a2dcbd194b9b830d21fd15290794 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=64c7cc6899a956553fd9eaeb86b311b5-926ca2c1b9a5445aa0e4d3a91b2e55ca 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------6584bf9b5b8f32601e42c1c143a39d16/ 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,613 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6584bf9b5b8f32601e42c1c143a39d16-57342b6eb9e5488ea73ae1e0233dc19b 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6584bf9b5b8f32601e42c1c143a39d16-dcea3dcf1dad44dc8f32d4d8ebd361d7 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------6b04deb8f8ca96911a3ed659e8e5b733/ 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b04deb8f8ca96911a3ed659e8e5b733-d9fea1ac5ce741d68102d0185ca09cda 2023-02-16 09:00:47,614 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b04deb8f8ca96911a3ed659e8e5b733-b1a4376e0e554567bc57106a1e594475 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------ba89d7c66a8a8c884967574e783608d0/ 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ba89d7c66a8a8c884967574e783608d0-86f8bd1db6b24ffd9a7999e96eb9422c 2023-02-16 09:00:47,615 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ba89d7c66a8a8c884967574e783608d0-9f5fda725269443292195b5b933aa9a7 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------c81406abc779d61fd932bc62cf3cd060/ 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c81406abc779d61fd932bc62cf3cd060-66df758de15f4192b880b76cc18e6c71 2023-02-16 09:00:47,616 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c81406abc779d61fd932bc62cf3cd060-0c31ccbbc555453296473f05e0220d51 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |----------d26efbdad702811f9081be173fc12f1b/ 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d26efbdad702811f9081be173fc12f1b-2f686ce58f654db2ab72ffd2b88f304c 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:47,617 DEBUG [Listener at localhost/37905] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d26efbdad702811f9081be173fc12f1b-c9a75af9d1354743a39134c315c08679 2023-02-16 09:00:47,621 INFO [Listener at localhost/37905] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 09:00:48,268 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,269 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,270 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,272 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:48,273 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1 2023-02-16 09:00:48,273 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cb0cd2ea2fd3a9d76f417c05b99736 columnFamilyName f1 2023-02-16 09:00:48,277 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/testWithMockedMapReduceMultiRegion=46cb0cd2ea2fd3a9d76f417c05b99736-974daa9098954e148b3db2acb017b4a4 2023-02-16 09:00:48,277 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(310): Store=46cb0cd2ea2fd3a9d76f417c05b99736/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,277 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:48,278 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2 2023-02-16 09:00:48,278 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46cb0cd2ea2fd3a9d76f417c05b99736 columnFamilyName f2 2023-02-16 09:00:48,282 DEBUG [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/testWithMockedMapReduceMultiRegion=46cb0cd2ea2fd3a9d76f417c05b99736-51ac832b4dc54e8d9686b538cdd3c52a 2023-02-16 09:00:48,282 INFO [StoreOpener-46cb0cd2ea2fd3a9d76f417c05b99736-1] regionserver.HStore(310): Store=46cb0cd2ea2fd3a9d76f417c05b99736/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,282 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,282 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 46cb0cd2ea2fd3a9d76f417c05b99736; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74309100, jitterRate=0.10729187726974487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,282 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:48,291 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 46cb0cd2ea2fd3a9d76f417c05b99736, disabling compactions & flushes 2023-02-16 09:00:48,291 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,292 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,292 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. after waiting 0 ms 2023-02-16 09:00:48,292 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,296 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,296 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:48,297 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,297 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,298 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,301 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:48,302 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1 2023-02-16 09:00:48,303 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64c7cc6899a956553fd9eaeb86b311b5 columnFamilyName f1 2023-02-16 09:00:48,308 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/testWithMockedMapReduceMultiRegion=64c7cc6899a956553fd9eaeb86b311b5-3382a2dcbd194b9b830d21fd15290794 2023-02-16 09:00:48,308 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(310): Store=64c7cc6899a956553fd9eaeb86b311b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,309 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:48,309 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2 2023-02-16 09:00:48,310 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64c7cc6899a956553fd9eaeb86b311b5 columnFamilyName f2 2023-02-16 09:00:48,315 DEBUG [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/testWithMockedMapReduceMultiRegion=64c7cc6899a956553fd9eaeb86b311b5-926ca2c1b9a5445aa0e4d3a91b2e55ca 2023-02-16 09:00:48,315 INFO [StoreOpener-64c7cc6899a956553fd9eaeb86b311b5-1] regionserver.HStore(310): Store=64c7cc6899a956553fd9eaeb86b311b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,316 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,316 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 64c7cc6899a956553fd9eaeb86b311b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65505199, jitterRate=-0.0238964706659317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,316 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:48,330 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 64c7cc6899a956553fd9eaeb86b311b5, disabling compactions & flushes 2023-02-16 09:00:48,330 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,330 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,330 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. after waiting 0 ms 2023-02-16 09:00:48,330 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,331 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,331 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:48,332 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,332 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,334 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,337 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:48,338 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f1 2023-02-16 09:00:48,338 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28e6c956cf96464e7ba155edeb2abdae columnFamilyName f1 2023-02-16 09:00:48,339 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(310): Store=28e6c956cf96464e7ba155edeb2abdae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,339 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:48,340 DEBUG [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f2 2023-02-16 09:00:48,341 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28e6c956cf96464e7ba155edeb2abdae columnFamilyName f2 2023-02-16 09:00:48,341 INFO [StoreOpener-28e6c956cf96464e7ba155edeb2abdae-1] regionserver.HStore(310): Store=28e6c956cf96464e7ba155edeb2abdae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,341 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,342 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 28e6c956cf96464e7ba155edeb2abdae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60580937, jitterRate=-0.09727369248867035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,342 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:48,342 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 28e6c956cf96464e7ba155edeb2abdae, disabling compactions & flushes 2023-02-16 09:00:48,342 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,342 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,342 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. after waiting 0 ms 2023-02-16 09:00:48,342 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,342 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,343 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:48,343 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,344 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,345 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,348 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:48,349 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1 2023-02-16 09:00:48,349 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 465321fabc91e7615954dc8804b23046 columnFamilyName f1 2023-02-16 09:00:48,354 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/testWithMockedMapReduceMultiRegion=465321fabc91e7615954dc8804b23046-4595eea05a8f42cd9ec1fe9682326564 2023-02-16 09:00:48,354 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(310): Store=465321fabc91e7615954dc8804b23046/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,354 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:48,355 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2 2023-02-16 09:00:48,356 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 465321fabc91e7615954dc8804b23046 columnFamilyName f2 2023-02-16 09:00:48,361 DEBUG [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/testWithMockedMapReduceMultiRegion=465321fabc91e7615954dc8804b23046-bac9362e49b7465090e8f997b2aeb68b 2023-02-16 09:00:48,361 INFO [StoreOpener-465321fabc91e7615954dc8804b23046-1] regionserver.HStore(310): Store=465321fabc91e7615954dc8804b23046/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,361 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,362 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 465321fabc91e7615954dc8804b23046; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59009513, jitterRate=-0.12068973481655121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,362 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:48,374 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 465321fabc91e7615954dc8804b23046, disabling compactions & flushes 2023-02-16 09:00:48,375 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,375 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,375 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. after waiting 0 ms 2023-02-16 09:00:48,375 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,377 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,377 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:48,378 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,378 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,381 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,383 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:48,384 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1 2023-02-16 09:00:48,384 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba89d7c66a8a8c884967574e783608d0 columnFamilyName f1 2023-02-16 09:00:48,388 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/testWithMockedMapReduceMultiRegion=ba89d7c66a8a8c884967574e783608d0-86f8bd1db6b24ffd9a7999e96eb9422c 2023-02-16 09:00:48,389 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(310): Store=ba89d7c66a8a8c884967574e783608d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,389 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:48,389 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2 2023-02-16 09:00:48,390 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba89d7c66a8a8c884967574e783608d0 columnFamilyName f2 2023-02-16 09:00:48,394 DEBUG [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/testWithMockedMapReduceMultiRegion=ba89d7c66a8a8c884967574e783608d0-9f5fda725269443292195b5b933aa9a7 2023-02-16 09:00:48,394 INFO [StoreOpener-ba89d7c66a8a8c884967574e783608d0-1] regionserver.HStore(310): Store=ba89d7c66a8a8c884967574e783608d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,394 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,394 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened ba89d7c66a8a8c884967574e783608d0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65870121, jitterRate=-0.018458709120750427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,394 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:48,409 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing ba89d7c66a8a8c884967574e783608d0, disabling compactions & flushes 2023-02-16 09:00:48,409 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,409 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,409 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. after waiting 0 ms 2023-02-16 09:00:48,409 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,411 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,411 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:48,411 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,412 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,413 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,415 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:48,415 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1 2023-02-16 09:00:48,416 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26efbdad702811f9081be173fc12f1b columnFamilyName f1 2023-02-16 09:00:48,420 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/testWithMockedMapReduceMultiRegion=d26efbdad702811f9081be173fc12f1b-2f686ce58f654db2ab72ffd2b88f304c 2023-02-16 09:00:48,420 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(310): Store=d26efbdad702811f9081be173fc12f1b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,420 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:48,421 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2 2023-02-16 09:00:48,421 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26efbdad702811f9081be173fc12f1b columnFamilyName f2 2023-02-16 09:00:48,424 DEBUG [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/testWithMockedMapReduceMultiRegion=d26efbdad702811f9081be173fc12f1b-c9a75af9d1354743a39134c315c08679 2023-02-16 09:00:48,424 INFO [StoreOpener-d26efbdad702811f9081be173fc12f1b-1] regionserver.HStore(310): Store=d26efbdad702811f9081be173fc12f1b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,425 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,425 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened d26efbdad702811f9081be173fc12f1b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75304954, jitterRate=0.12213125824928284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,425 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:48,432 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing d26efbdad702811f9081be173fc12f1b, disabling compactions & flushes 2023-02-16 09:00:48,433 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,433 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,433 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. after waiting 0 ms 2023-02-16 09:00:48,433 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,433 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,433 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:48,434 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,434 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,435 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,437 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:48,438 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1 2023-02-16 09:00:48,438 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81406abc779d61fd932bc62cf3cd060 columnFamilyName f1 2023-02-16 09:00:48,442 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/testWithMockedMapReduceMultiRegion=c81406abc779d61fd932bc62cf3cd060-66df758de15f4192b880b76cc18e6c71 2023-02-16 09:00:48,442 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(310): Store=c81406abc779d61fd932bc62cf3cd060/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,442 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:48,443 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2 2023-02-16 09:00:48,443 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81406abc779d61fd932bc62cf3cd060 columnFamilyName f2 2023-02-16 09:00:48,450 DEBUG [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/testWithMockedMapReduceMultiRegion=c81406abc779d61fd932bc62cf3cd060-0c31ccbbc555453296473f05e0220d51 2023-02-16 09:00:48,450 INFO [StoreOpener-c81406abc779d61fd932bc62cf3cd060-1] regionserver.HStore(310): Store=c81406abc779d61fd932bc62cf3cd060/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,451 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,451 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened c81406abc779d61fd932bc62cf3cd060; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65978931, jitterRate=-0.016837313771247864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,451 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:48,459 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing c81406abc779d61fd932bc62cf3cd060, disabling compactions & flushes 2023-02-16 09:00:48,459 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,459 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,459 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. after waiting 0 ms 2023-02-16 09:00:48,459 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,460 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,460 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:48,460 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,460 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,462 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,463 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:48,464 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f1 2023-02-16 09:00:48,465 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 615726a9a6c6f0cafeab86e9d83cc775 columnFamilyName f1 2023-02-16 09:00:48,465 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(310): Store=615726a9a6c6f0cafeab86e9d83cc775/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,465 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:48,466 DEBUG [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f2 2023-02-16 09:00:48,466 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 615726a9a6c6f0cafeab86e9d83cc775 columnFamilyName f2 2023-02-16 09:00:48,466 INFO [StoreOpener-615726a9a6c6f0cafeab86e9d83cc775-1] regionserver.HStore(310): Store=615726a9a6c6f0cafeab86e9d83cc775/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,467 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 615726a9a6c6f0cafeab86e9d83cc775; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75110286, jitterRate=0.1192304790019989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 615726a9a6c6f0cafeab86e9d83cc775, disabling compactions & flushes 2023-02-16 09:00:48,467 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. after waiting 0 ms 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,467 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,467 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:48,468 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,468 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,469 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,471 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:48,471 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1 2023-02-16 09:00:48,472 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6584bf9b5b8f32601e42c1c143a39d16 columnFamilyName f1 2023-02-16 09:00:48,475 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/testWithMockedMapReduceMultiRegion=6584bf9b5b8f32601e42c1c143a39d16-57342b6eb9e5488ea73ae1e0233dc19b 2023-02-16 09:00:48,475 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(310): Store=6584bf9b5b8f32601e42c1c143a39d16/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,475 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:48,476 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2 2023-02-16 09:00:48,476 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6584bf9b5b8f32601e42c1c143a39d16 columnFamilyName f2 2023-02-16 09:00:48,479 DEBUG [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/testWithMockedMapReduceMultiRegion=6584bf9b5b8f32601e42c1c143a39d16-dcea3dcf1dad44dc8f32d4d8ebd361d7 2023-02-16 09:00:48,479 INFO [StoreOpener-6584bf9b5b8f32601e42c1c143a39d16-1] regionserver.HStore(310): Store=6584bf9b5b8f32601e42c1c143a39d16/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,480 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,480 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 6584bf9b5b8f32601e42c1c143a39d16; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63979383, jitterRate=-0.04663290083408356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,480 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:48,488 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 6584bf9b5b8f32601e42c1c143a39d16, disabling compactions & flushes 2023-02-16 09:00:48,488 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,488 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,488 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. after waiting 0 ms 2023-02-16 09:00:48,488 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,489 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,489 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:48,489 DEBUG [Listener at localhost/37905] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:48,490 INFO [Listener at localhost/37905] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:48,491 DEBUG [Listener at localhost/37905] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:48,492 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:48,493 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1 2023-02-16 09:00:48,493 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b04deb8f8ca96911a3ed659e8e5b733 columnFamilyName f1 2023-02-16 09:00:48,497 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/testWithMockedMapReduceMultiRegion=6b04deb8f8ca96911a3ed659e8e5b733-d9fea1ac5ce741d68102d0185ca09cda 2023-02-16 09:00:48,497 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(310): Store=6b04deb8f8ca96911a3ed659e8e5b733/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,497 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:48,497 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2 2023-02-16 09:00:48,498 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b04deb8f8ca96911a3ed659e8e5b733 columnFamilyName f2 2023-02-16 09:00:48,501 DEBUG [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(539): loaded hdfs://localhost:38441/user/jenkins/test-data/98f23365-38f5-1dc5-b027-72cfa1ab424c/testWithMockedMapReduceMultiRegion/a34058d0-8873-4667-8d4d-41580abdf00f/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/testWithMockedMapReduceMultiRegion=6b04deb8f8ca96911a3ed659e8e5b733-b1a4376e0e554567bc57106a1e594475 2023-02-16 09:00:48,501 INFO [StoreOpener-6b04deb8f8ca96911a3ed659e8e5b733-1] regionserver.HStore(310): Store=6b04deb8f8ca96911a3ed659e8e5b733/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:48,501 DEBUG [Listener at localhost/37905] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:48,501 INFO [Listener at localhost/37905] regionserver.HRegion(1071): Opened 6b04deb8f8ca96911a3ed659e8e5b733; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73946899, jitterRate=0.10189466178417206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:48,501 DEBUG [Listener at localhost/37905] regionserver.HRegion(964): Region open journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:48,509 DEBUG [Listener at localhost/37905] regionserver.HRegion(1603): Closing 6b04deb8f8ca96911a3ed659e8e5b733, disabling compactions & flushes 2023-02-16 09:00:48,509 INFO [Listener at localhost/37905] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,509 DEBUG [Listener at localhost/37905] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,509 DEBUG [Listener at localhost/37905] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. after waiting 0 ms 2023-02-16 09:00:48,509 DEBUG [Listener at localhost/37905] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,510 INFO [Listener at localhost/37905] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,510 DEBUG [Listener at localhost/37905] regionserver.HRegion(1557): Region close journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:48,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-16 09:00:48,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-16 09:00:48,517 INFO [Listener at localhost/37905] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 09:00:48,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 09:00:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:48,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:48,521 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538048521"}]},"ts":"1676538048521"} 2023-02-16 09:00:48,522 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-16 09:00:48,586 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-16 09:00:48,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, UNASSIGN}] 2023-02-16 09:00:48,589 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, UNASSIGN 2023-02-16 09:00:48,589 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, UNASSIGN 2023-02-16 09:00:48,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, UNASSIGN 2023-02-16 09:00:48,589 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, UNASSIGN 2023-02-16 09:00:48,589 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, UNASSIGN 2023-02-16 09:00:48,589 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6b04deb8f8ca96911a3ed659e8e5b733, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:48,589 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=46cb0cd2ea2fd3a9d76f417c05b99736, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:48,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=615726a9a6c6f0cafeab86e9d83cc775, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:48,590 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048589"}]},"ts":"1676538048589"} 2023-02-16 09:00:48,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=64c7cc6899a956553fd9eaeb86b311b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:48,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048589"}]},"ts":"1676538048589"} 2023-02-16 09:00:48,590 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048589"}]},"ts":"1676538048589"} 2023-02-16 09:00:48,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=28e6c956cf96464e7ba155edeb2abdae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:48,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538048589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048589"}]},"ts":"1676538048589"} 2023-02-16 09:00:48,590 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538048590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048590"}]},"ts":"1676538048590"} 2023-02-16 09:00:48,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure 46cb0cd2ea2fd3a9d76f417c05b99736, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:48,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 6b04deb8f8ca96911a3ed659e8e5b733, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:48,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 64c7cc6899a956553fd9eaeb86b311b5, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:48,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=34, state=RUNNABLE; CloseRegionProcedure 615726a9a6c6f0cafeab86e9d83cc775, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:48,593 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, UNASSIGN 2023-02-16 09:00:48,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 28e6c956cf96464e7ba155edeb2abdae, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:48,594 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ba89d7c66a8a8c884967574e783608d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:48,594 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, UNASSIGN 2023-02-16 09:00:48,594 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048594"}]},"ts":"1676538048594"} 2023-02-16 09:00:48,595 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=c81406abc779d61fd932bc62cf3cd060, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:48,595 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, UNASSIGN 2023-02-16 09:00:48,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048595"}]},"ts":"1676538048595"} 2023-02-16 09:00:48,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure ba89d7c66a8a8c884967574e783608d0, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:48,596 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, UNASSIGN 2023-02-16 09:00:48,596 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=465321fabc91e7615954dc8804b23046, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:48,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048596"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048596"}]},"ts":"1676538048596"} 2023-02-16 09:00:48,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure c81406abc779d61fd932bc62cf3cd060, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:48,596 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6584bf9b5b8f32601e42c1c143a39d16, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:48,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048596"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048596"}]},"ts":"1676538048596"} 2023-02-16 09:00:48,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, UNASSIGN 2023-02-16 09:00:48,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 465321fabc91e7615954dc8804b23046, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:48,598 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d26efbdad702811f9081be173fc12f1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:48,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538048598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538048598"}]},"ts":"1676538048598"} 2023-02-16 09:00:48,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 6584bf9b5b8f32601e42c1c143a39d16, server=jenkins-hbase4.apache.org,36163,1676538043474}] 2023-02-16 09:00:48,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure d26efbdad702811f9081be173fc12f1b, server=jenkins-hbase4.apache.org,40519,1676538043503}] 2023-02-16 09:00:48,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:48,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:48,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c81406abc779d61fd932bc62cf3cd060, disabling compactions & flushes 2023-02-16 09:00:48,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. after waiting 0 ms 2023-02-16 09:00:48,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:48,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6584bf9b5b8f32601e42c1c143a39d16, disabling compactions & flushes 2023-02-16 09:00:48,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. after waiting 0 ms 2023-02-16 09:00:48,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060. 2023-02-16 09:00:48,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c81406abc779d61fd932bc62cf3cd060: 2023-02-16 09:00:48,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16. 2023-02-16 09:00:48,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6584bf9b5b8f32601e42c1c143a39d16: 2023-02-16 09:00:48,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:48,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:48,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 46cb0cd2ea2fd3a9d76f417c05b99736, disabling compactions & flushes 2023-02-16 09:00:48,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. after waiting 0 ms 2023-02-16 09:00:48,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,749 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=c81406abc779d61fd932bc62cf3cd060, regionState=CLOSED 2023-02-16 09:00:48,749 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048749"}]},"ts":"1676538048749"} 2023-02-16 09:00:48,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:48,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:48,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ba89d7c66a8a8c884967574e783608d0, disabling compactions & flushes 2023-02-16 09:00:48,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. after waiting 0 ms 2023-02-16 09:00:48,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,750 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6584bf9b5b8f32601e42c1c143a39d16, regionState=CLOSED 2023-02-16 09:00:48,750 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048750"}]},"ts":"1676538048750"} 2023-02-16 09:00:48,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-16 09:00:48,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure c81406abc779d61fd932bc62cf3cd060, server=jenkins-hbase4.apache.org,40519,1676538043503 in 155 msec 2023-02-16 09:00:48,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-16 09:00:48,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 6584bf9b5b8f32601e42c1c143a39d16, server=jenkins-hbase4.apache.org,36163,1676538043474 in 153 msec 2023-02-16 09:00:48,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c81406abc779d61fd932bc62cf3cd060, UNASSIGN in 165 msec 2023-02-16 09:00:48,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6584bf9b5b8f32601e42c1c143a39d16, UNASSIGN in 166 msec 2023-02-16 09:00:48,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736. 2023-02-16 09:00:48,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 46cb0cd2ea2fd3a9d76f417c05b99736: 2023-02-16 09:00:48,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0. 2023-02-16 09:00:48,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ba89d7c66a8a8c884967574e783608d0: 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 615726a9a6c6f0cafeab86e9d83cc775, disabling compactions & flushes 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. after waiting 0 ms 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,759 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=46cb0cd2ea2fd3a9d76f417c05b99736, regionState=CLOSED 2023-02-16 09:00:48,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048759"}]},"ts":"1676538048759"} 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6b04deb8f8ca96911a3ed659e8e5b733, disabling compactions & flushes 2023-02-16 09:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. after waiting 0 ms 2023-02-16 09:00:48,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,760 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ba89d7c66a8a8c884967574e783608d0, regionState=CLOSED 2023-02-16 09:00:48,760 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048760"}]},"ts":"1676538048760"} 2023-02-16 09:00:48,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-16 09:00:48,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:48,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure 46cb0cd2ea2fd3a9d76f417c05b99736, server=jenkins-hbase4.apache.org,40519,1676538043503 in 170 msec 2023-02-16 09:00:48,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775. 2023-02-16 09:00:48,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-16 09:00:48,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 615726a9a6c6f0cafeab86e9d83cc775: 2023-02-16 09:00:48,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure ba89d7c66a8a8c884967574e783608d0, server=jenkins-hbase4.apache.org,36163,1676538043474 in 166 msec 2023-02-16 09:00:48,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=46cb0cd2ea2fd3a9d76f417c05b99736, UNASSIGN in 175 msec 2023-02-16 09:00:48,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba89d7c66a8a8c884967574e783608d0, UNASSIGN in 176 msec 2023-02-16 09:00:48,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:48,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:48,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d26efbdad702811f9081be173fc12f1b, disabling compactions & flushes 2023-02-16 09:00:48,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=615726a9a6c6f0cafeab86e9d83cc775, regionState=CLOSED 2023-02-16 09:00:48,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. after waiting 0 ms 2023-02-16 09:00:48,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,764 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538048764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048764"}]},"ts":"1676538048764"} 2023-02-16 09:00:48,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733. 2023-02-16 09:00:48,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6b04deb8f8ca96911a3ed659e8e5b733: 2023-02-16 09:00:48,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b. 2023-02-16 09:00:48,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d26efbdad702811f9081be173fc12f1b: 2023-02-16 09:00:48,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6b04deb8f8ca96911a3ed659e8e5b733, regionState=CLOSED 2023-02-16 09:00:48,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048769"}]},"ts":"1676538048769"} 2023-02-16 09:00:48,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=34 2023-02-16 09:00:48,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=34, state=SUCCESS; CloseRegionProcedure 615726a9a6c6f0cafeab86e9d83cc775, server=jenkins-hbase4.apache.org,40519,1676538043503 in 173 msec 2023-02-16 09:00:48,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:48,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:48,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 28e6c956cf96464e7ba155edeb2abdae, disabling compactions & flushes 2023-02-16 09:00:48,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. after waiting 0 ms 2023-02-16 09:00:48,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=615726a9a6c6f0cafeab86e9d83cc775, UNASSIGN in 182 msec 2023-02-16 09:00:48,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d26efbdad702811f9081be173fc12f1b, regionState=CLOSED 2023-02-16 09:00:48,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048770"}]},"ts":"1676538048770"} 2023-02-16 09:00:48,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 09:00:48,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-16 09:00:48,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 6b04deb8f8ca96911a3ed659e8e5b733, server=jenkins-hbase4.apache.org,36163,1676538043474 in 181 msec 2023-02-16 09:00:48,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-16 09:00:48,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure d26efbdad702811f9081be173fc12f1b, server=jenkins-hbase4.apache.org,40519,1676538043503 in 171 msec 2023-02-16 09:00:48,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae. 2023-02-16 09:00:48,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b04deb8f8ca96911a3ed659e8e5b733, UNASSIGN in 187 msec 2023-02-16 09:00:48,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 28e6c956cf96464e7ba155edeb2abdae: 2023-02-16 09:00:48,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26efbdad702811f9081be173fc12f1b, UNASSIGN in 187 msec 2023-02-16 09:00:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:48,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 64c7cc6899a956553fd9eaeb86b311b5, disabling compactions & flushes 2023-02-16 09:00:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. after waiting 0 ms 2023-02-16 09:00:48,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=28e6c956cf96464e7ba155edeb2abdae, regionState=CLOSED 2023-02-16 09:00:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:48,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676538048776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048776"}]},"ts":"1676538048776"} 2023-02-16 09:00:48,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-16 09:00:48,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 28e6c956cf96464e7ba155edeb2abdae, server=jenkins-hbase4.apache.org,40519,1676538043503 in 183 msec 2023-02-16 09:00:48,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=28e6c956cf96464e7ba155edeb2abdae, UNASSIGN in 192 msec 2023-02-16 09:00:48,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5. 2023-02-16 09:00:48,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 64c7cc6899a956553fd9eaeb86b311b5: 2023-02-16 09:00:48,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:48,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:48,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 465321fabc91e7615954dc8804b23046, disabling compactions & flushes 2023-02-16 09:00:48,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. after waiting 0 ms 2023-02-16 09:00:48,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=64c7cc6899a956553fd9eaeb86b311b5, regionState=CLOSED 2023-02-16 09:00:48,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048787"}]},"ts":"1676538048787"} 2023-02-16 09:00:48,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-16 09:00:48,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 64c7cc6899a956553fd9eaeb86b311b5, server=jenkins-hbase4.apache.org,36163,1676538043474 in 196 msec 2023-02-16 09:00:48,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=64c7cc6899a956553fd9eaeb86b311b5, UNASSIGN in 202 msec 2023-02-16 09:00:48,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:48,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046. 2023-02-16 09:00:48,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 465321fabc91e7615954dc8804b23046: 2023-02-16 09:00:48,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 465321fabc91e7615954dc8804b23046 2023-02-16 09:00:48,792 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=465321fabc91e7615954dc8804b23046, regionState=CLOSED 2023-02-16 09:00:48,792 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676538048792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538048792"}]},"ts":"1676538048792"} 2023-02-16 09:00:48,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-16 09:00:48,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 465321fabc91e7615954dc8804b23046, server=jenkins-hbase4.apache.org,36163,1676538043474 in 196 msec 2023-02-16 09:00:48,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-16 09:00:48,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=465321fabc91e7615954dc8804b23046, UNASSIGN in 207 msec 2023-02-16 09:00:48,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538048796"}]},"ts":"1676538048796"} 2023-02-16 09:00:48,797 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-16 09:00:48,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:48,855 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-16 09:00:48,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 338 msec 2023-02-16 09:00:49,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 09:00:49,125 INFO [Listener at localhost/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-16 09:00:49,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,128 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,129 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:49,140 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:49,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/recovered.edits] 2023-02-16 09:00:49,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/recovered.edits] 2023-02-16 09:00:49,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/recovered.edits] 2023-02-16 09:00:49,145 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/recovered.edits] 2023-02-16 09:00:49,145 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/recovered.edits] 2023-02-16 09:00:49,147 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/recovered.edits] 2023-02-16 09:00:49,147 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/recovered.edits] 2023-02-16 09:00:49,148 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/recovered.edits] 2023-02-16 09:00:49,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/66df758de15f4192b880b76cc18e6c71 2023-02-16 09:00:49,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/79f4439e4fbd4f8b97ecdcba5ec91cce to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/79f4439e4fbd4f8b97ecdcba5ec91cce 2023-02-16 09:00:49,153 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/57342b6eb9e5488ea73ae1e0233dc19b 2023-02-16 09:00:49,154 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/4595eea05a8f42cd9ec1fe9682326564 2023-02-16 09:00:49,154 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/3382a2dcbd194b9b830d21fd15290794 2023-02-16 09:00:49,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/2f686ce58f654db2ab72ffd2b88f304c 2023-02-16 09:00:49,156 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/7f09cb6c2043484c922997c95f7398af to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f1/7f09cb6c2043484c922997c95f7398af 2023-02-16 09:00:49,156 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f1/b9e70ca8c93b4a7a84e6fb06fbaa95d1 2023-02-16 09:00:49,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/aa398149612e43038c0198881e693fb7 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f1/aa398149612e43038c0198881e693fb7 2023-02-16 09:00:49,157 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f1/974daa9098954e148b3db2acb017b4a4 2023-02-16 09:00:49,157 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/759c29d6fbeb4cf98adb25b01e3e752e to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/759c29d6fbeb4cf98adb25b01e3e752e 2023-02-16 09:00:49,157 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/a5657a0a4fc64afebfb8400c934abc71 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f1/a5657a0a4fc64afebfb8400c934abc71 2023-02-16 09:00:49,158 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/ae2e967a140a4aa5be721d4c864a707d to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f1/ae2e967a140a4aa5be721d4c864a707d 2023-02-16 09:00:49,159 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/recovered.edits/6.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775/recovered.edits/6.seqid 2023-02-16 09:00:49,159 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f1/d9fea1ac5ce741d68102d0185ca09cda 2023-02-16 09:00:49,161 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/615726a9a6c6f0cafeab86e9d83cc775 2023-02-16 09:00:49,161 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:49,162 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/5f3241e6a0ee409cbc150e94e87c7380 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/5f3241e6a0ee409cbc150e94e87c7380 2023-02-16 09:00:49,163 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/926ca2c1b9a5445aa0e4d3a91b2e55ca 2023-02-16 09:00:49,163 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/0c31ccbbc555453296473f05e0220d51 2023-02-16 09:00:49,163 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/bac9362e49b7465090e8f997b2aeb68b 2023-02-16 09:00:49,164 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/recovered.edits] 2023-02-16 09:00:49,165 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/ea1589772cca4211aa30e5f08e7ba051 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/f2/ea1589772cca4211aa30e5f08e7ba051 2023-02-16 09:00:49,165 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/f2/dcea3dcf1dad44dc8f32d4d8ebd361d7 2023-02-16 09:00:49,165 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/51ac832b4dc54e8d9686b538cdd3c52a 2023-02-16 09:00:49,165 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/b762343cdd634509a0cbd37fdd9c38db to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/b762343cdd634509a0cbd37fdd9c38db 2023-02-16 09:00:49,165 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/ad2f8203e317496c98ab9b6f795582c3 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/f2/ad2f8203e317496c98ab9b6f795582c3 2023-02-16 09:00:49,166 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/c9b77a0e047e4ff793f0cc929f0dfbbe to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/f2/c9b77a0e047e4ff793f0cc929f0dfbbe 2023-02-16 09:00:49,166 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/8b3bad3026d54e978695d472e1db7e94 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/8b3bad3026d54e978695d472e1db7e94 2023-02-16 09:00:49,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/a0986fa5bed84d5fa0edec6ade281816 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/f2/a0986fa5bed84d5fa0edec6ade281816 2023-02-16 09:00:49,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/f2/c9a75af9d1354743a39134c315c08679 2023-02-16 09:00:49,168 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/f2/b1a4376e0e554567bc57106a1e594475 2023-02-16 09:00:49,171 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046/recovered.edits/12.seqid 2023-02-16 09:00:49,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/465321fabc91e7615954dc8804b23046 2023-02-16 09:00:49,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:49,172 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16/recovered.edits/12.seqid 2023-02-16 09:00:49,173 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b/recovered.edits/12.seqid 2023-02-16 09:00:49,173 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060/recovered.edits/12.seqid 2023-02-16 09:00:49,173 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6584bf9b5b8f32601e42c1c143a39d16 2023-02-16 09:00:49,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/86f8bd1db6b24ffd9a7999e96eb9422c 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26efbdad702811f9081be173fc12f1b 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733/recovered.edits/12.seqid 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5/recovered.edits/12.seqid 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/c81406abc779d61fd932bc62cf3cd060 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b04deb8f8ca96911a3ed659e8e5b733 2023-02-16 09:00:49,174 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736/recovered.edits/12.seqid 2023-02-16 09:00:49,175 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/64c7cc6899a956553fd9eaeb86b311b5 2023-02-16 09:00:49,175 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f1, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/f2, FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/recovered.edits] 2023-02-16 09:00:49,175 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/46cb0cd2ea2fd3a9d76f417c05b99736 2023-02-16 09:00:49,175 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/aec6949e490044cc9e668eeba68c537a to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f1/aec6949e490044cc9e668eeba68c537a 2023-02-16 09:00:49,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/7fea1906220a41b080ea9f509b4893ad to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/7fea1906220a41b080ea9f509b4893ad 2023-02-16 09:00:49,179 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7 to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/f2/9f5fda725269443292195b5b933aa9a7 2023-02-16 09:00:49,179 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/recovered.edits/6.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae/recovered.edits/6.seqid 2023-02-16 09:00:49,179 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/28e6c956cf96464e7ba155edeb2abdae 2023-02-16 09:00:49,181 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/recovered.edits/12.seqid to hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/archive/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0/recovered.edits/12.seqid 2023-02-16 09:00:49,181 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba89d7c66a8a8c884967574e783608d0 2023-02-16 09:00:49,181 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 09:00:49,183 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,186 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-16 09:00:49,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-16 09:00:49,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676538044749.465321fabc91e7615954dc8804b23046.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538049234"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,236 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 09:00:49,236 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 615726a9a6c6f0cafeab86e9d83cc775, NAME => 'testWithMockedMapReduceMultiRegion,,1676538044749.615726a9a6c6f0cafeab86e9d83cc775.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 64c7cc6899a956553fd9eaeb86b311b5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676538044749.64c7cc6899a956553fd9eaeb86b311b5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 6b04deb8f8ca96911a3ed659e8e5b733, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676538044749.6b04deb8f8ca96911a3ed659e8e5b733.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 46cb0cd2ea2fd3a9d76f417c05b99736, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676538044749.46cb0cd2ea2fd3a9d76f417c05b99736.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => d26efbdad702811f9081be173fc12f1b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676538044749.d26efbdad702811f9081be173fc12f1b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 6584bf9b5b8f32601e42c1c143a39d16, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676538044749.6584bf9b5b8f32601e42c1c143a39d16.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 465321fabc91e7615954dc8804b23046, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676538044749.465321fabc91e7615954dc8804b23046.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => c81406abc779d61fd932bc62cf3cd060, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676538044749.c81406abc779d61fd932bc62cf3cd060.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => ba89d7c66a8a8c884967574e783608d0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676538044749.ba89d7c66a8a8c884967574e783608d0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 28e6c956cf96464e7ba155edeb2abdae, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676538044749.28e6c956cf96464e7ba155edeb2abdae.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 09:00:49,236 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-16 09:00:49,236 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538049236"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:49,237 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-16 09:00:49,255 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 09:00:49,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 129 msec 2023-02-16 09:00:49,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 09:00:49,432 INFO [Listener at localhost/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-16 09:00:49,432 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:49,432 INFO [Listener at localhost/37905] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:49,432 DEBUG [Listener at localhost/37905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x005c7ad7 to 127.0.0.1:57407 2023-02-16 09:00:49,432 DEBUG [Listener at localhost/37905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,432 DEBUG [Listener at localhost/37905] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:49,432 DEBUG [Listener at localhost/37905] util.JVMClusterUtil(257): Found active master hash=1883681759, stopped=false 2023-02-16 09:00:49,433 INFO [Listener at localhost/37905] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:49,435 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:49,435 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:49,435 INFO [Listener at localhost/37905] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:49,435 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:49,435 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:49,437 DEBUG [Listener at localhost/37905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e6820f6 to 127.0.0.1:57407 2023-02-16 09:00:49,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:49,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:49,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:49,437 DEBUG [Listener at localhost/37905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,437 INFO [Listener at localhost/37905] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36163,1676538043474' ***** 2023-02-16 09:00:49,437 INFO [Listener at localhost/37905] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:49,437 INFO [Listener at localhost/37905] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40519,1676538043503' ***** 2023-02-16 09:00:49,437 INFO [Listener at localhost/37905] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:49,438 INFO [RS:1;jenkins-hbase4:40519] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:49,438 INFO [RS:0;jenkins-hbase4:36163] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:49,438 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:49,438 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:49,438 INFO [RS:1;jenkins-hbase4:40519] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:49,438 INFO [RS:0;jenkins-hbase4:36163] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:49,439 INFO [RS:1;jenkins-hbase4:40519] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:49,439 INFO [RS:0;jenkins-hbase4:36163] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:49,439 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:49,439 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(3304): Received CLOSE for f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:49,439 DEBUG [RS:1;jenkins-hbase4:40519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e8a5f84 to 127.0.0.1:57407 2023-02-16 09:00:49,439 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:49,439 DEBUG [RS:1;jenkins-hbase4:40519] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,439 DEBUG [RS:0;jenkins-hbase4:36163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52a78731 to 127.0.0.1:57407 2023-02-16 09:00:49,439 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40519,1676538043503; all regions closed. 2023-02-16 09:00:49,439 DEBUG [RS:0;jenkins-hbase4:36163] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,440 INFO [RS:0;jenkins-hbase4:36163] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:49,440 INFO [RS:0;jenkins-hbase4:36163] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:49,440 INFO [RS:0;jenkins-hbase4:36163] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:49,440 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:49,440 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 09:00:49,440 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, f052463a33ef1bde26e436250fff4a77=hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77.} 2023-02-16 09:00:49,440 DEBUG [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1505): Waiting on 1588230740, f052463a33ef1bde26e436250fff4a77 2023-02-16 09:00:49,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f052463a33ef1bde26e436250fff4a77, disabling compactions & flushes 2023-02-16 09:00:49,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:49,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:49,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:49,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. after waiting 0 ms 2023-02-16 09:00:49,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:49,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f052463a33ef1bde26e436250fff4a77 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:49,447 DEBUG [RS:1;jenkins-hbase4:40519] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs 2023-02-16 09:00:49,447 INFO [RS:1;jenkins-hbase4:40519] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40519%2C1676538043503:(num 1676538044808) 2023-02-16 09:00:49,447 DEBUG [RS:1;jenkins-hbase4:40519] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,447 INFO [RS:1;jenkins-hbase4:40519] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:49,447 INFO [RS:1;jenkins-hbase4:40519] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:49,447 INFO [RS:1;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:49,448 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:49,448 INFO [RS:1;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:49,448 INFO [RS:1;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:49,449 INFO [RS:1;jenkins-hbase4:40519] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40519 2023-02-16 09:00:49,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/.tmp/info/862767b6dfda4ee0ae443c9c094db215 2023-02-16 09:00:49,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/info/6f5e881543e5472498187e9ca84a42f5 2023-02-16 09:00:49,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f5e881543e5472498187e9ca84a42f5 2023-02-16 09:00:49,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/.tmp/info/862767b6dfda4ee0ae443c9c094db215 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/info/862767b6dfda4ee0ae443c9c094db215 2023-02-16 09:00:49,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/info/862767b6dfda4ee0ae443c9c094db215, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:49,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f052463a33ef1bde26e436250fff4a77 in 31ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/namespace/f052463a33ef1bde26e436250fff4a77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:49,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f052463a33ef1bde26e436250fff4a77: 2023-02-16 09:00:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538044154.f052463a33ef1bde26e436250fff4a77. 2023-02-16 09:00:49,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/rep_barrier/24b41ec0709249fdad8f7ebe8dfe2998 2023-02-16 09:00:49,488 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24b41ec0709249fdad8f7ebe8dfe2998 2023-02-16 09:00:49,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/table/aa9044d27cdb40499dd3a227aaef1ff2 2023-02-16 09:00:49,511 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa9044d27cdb40499dd3a227aaef1ff2 2023-02-16 09:00:49,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/info/6f5e881543e5472498187e9ca84a42f5 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/info/6f5e881543e5472498187e9ca84a42f5 2023-02-16 09:00:49,514 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:49,515 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:49,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f5e881543e5472498187e9ca84a42f5 2023-02-16 09:00:49,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/info/6f5e881543e5472498187e9ca84a42f5, entries=30, sequenceid=57, filesize=8.3 K 2023-02-16 09:00:49,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/rep_barrier/24b41ec0709249fdad8f7ebe8dfe2998 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/rep_barrier/24b41ec0709249fdad8f7ebe8dfe2998 2023-02-16 09:00:49,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24b41ec0709249fdad8f7ebe8dfe2998 2023-02-16 09:00:49,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/rep_barrier/24b41ec0709249fdad8f7ebe8dfe2998, entries=10, sequenceid=57, filesize=6.1 K 2023-02-16 09:00:49,525 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/.tmp/table/aa9044d27cdb40499dd3a227aaef1ff2 as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/table/aa9044d27cdb40499dd3a227aaef1ff2 2023-02-16 09:00:49,529 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa9044d27cdb40499dd3a227aaef1ff2 2023-02-16 09:00:49,529 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/table/aa9044d27cdb40499dd3a227aaef1ff2, entries=13, sequenceid=57, filesize=6.1 K 2023-02-16 09:00:49,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=57, compaction requested=false 2023-02-16 09:00:49,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 09:00:49,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:49,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:49,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:49,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:49,542 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:49,542 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:49,542 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47dc0a0a rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,542 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:49,542 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40519,1676538043503 2023-02-16 09:00:49,542 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10865491 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,543 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:49,543 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40519,1676538043503] 2023-02-16 09:00:49,543 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40519,1676538043503; numProcessing=1 2023-02-16 09:00:49,544 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40519,1676538043503 already deleted, retry=false 2023-02-16 09:00:49,544 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40519,1676538043503 expired; onlineServers=1 2023-02-16 09:00:49,619 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:00:49,640 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36163,1676538043474; all regions closed. 2023-02-16 09:00:49,645 DEBUG [RS:0;jenkins-hbase4:36163] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs 2023-02-16 09:00:49,645 INFO [RS:0;jenkins-hbase4:36163] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36163%2C1676538043474.meta:.meta(num 1676538044094) 2023-02-16 09:00:49,648 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/WALs/jenkins-hbase4.apache.org,36163,1676538043474/jenkins-hbase4.apache.org%2C36163%2C1676538043474.1676538044523 not finished, retry = 0 2023-02-16 09:00:49,750 DEBUG [RS:0;jenkins-hbase4:36163] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/oldWALs 2023-02-16 09:00:49,750 INFO [RS:0;jenkins-hbase4:36163] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36163%2C1676538043474:(num 1676538044523) 2023-02-16 09:00:49,750 DEBUG [RS:0;jenkins-hbase4:36163] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,750 INFO [RS:0;jenkins-hbase4:36163] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:49,750 INFO [RS:0;jenkins-hbase4:36163] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:49,750 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:49,751 INFO [RS:0;jenkins-hbase4:36163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36163 2023-02-16 09:00:49,753 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36163,1676538043474 2023-02-16 09:00:49,753 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:49,753 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@151ab357 rejected from java.util.concurrent.ThreadPoolExecutor@1125352c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,754 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36163,1676538043474] 2023-02-16 09:00:49,754 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36163,1676538043474; numProcessing=2 2023-02-16 09:00:49,756 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36163,1676538043474 already deleted, retry=false 2023-02-16 09:00:49,756 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36163,1676538043474 expired; onlineServers=0 2023-02-16 09:00:49,756 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42815,1676538043426' ***** 2023-02-16 09:00:49,756 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:49,757 DEBUG [M:0;jenkins-hbase4:42815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7479290f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:49,757 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42815,1676538043426 2023-02-16 09:00:49,757 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42815,1676538043426; all regions closed. 2023-02-16 09:00:49,757 DEBUG [M:0;jenkins-hbase4:42815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:49,757 DEBUG [M:0;jenkins-hbase4:42815] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:49,757 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:49,757 DEBUG [M:0;jenkins-hbase4:42815] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:49,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538043673] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538043673,5,FailOnTimeoutGroup] 2023-02-16 09:00:49,757 INFO [M:0;jenkins-hbase4:42815] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:49,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538043674] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538043674,5,FailOnTimeoutGroup] 2023-02-16 09:00:49,758 INFO [M:0;jenkins-hbase4:42815] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:49,758 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:49,759 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:49,759 INFO [M:0;jenkins-hbase4:42815] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:49,759 DEBUG [M:0;jenkins-hbase4:42815] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:49,759 INFO [M:0;jenkins-hbase4:42815] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:49,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:49,760 ERROR [M:0;jenkins-hbase4:42815] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:00:49,760 INFO [M:0;jenkins-hbase4:42815] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:49,760 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:49,760 DEBUG [M:0;jenkins-hbase4:42815] zookeeper.ZKUtil(398): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:49,760 WARN [M:0;jenkins-hbase4:42815] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:49,760 INFO [M:0;jenkins-hbase4:42815] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:49,761 INFO [M:0;jenkins-hbase4:42815] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:49,761 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:49,761 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:49,761 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:49,761 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:49,761 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:49,761 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-16 09:00:49,769 INFO [M:0;jenkins-hbase4:42815] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d96bec0046974c8da223189d20218c6f 2023-02-16 09:00:49,773 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d96bec0046974c8da223189d20218c6f as hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d96bec0046974c8da223189d20218c6f 2023-02-16 09:00:49,776 INFO [M:0;jenkins-hbase4:42815] regionserver.HStore(1080): Added hdfs://localhost:38441/user/jenkins/test-data/c8376869-f606-b4d0-ed46-1995e3166794/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d96bec0046974c8da223189d20218c6f, entries=53, sequenceid=357, filesize=10.7 K 2023-02-16 09:00:49,776 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-16 09:00:49,777 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:49,777 DEBUG [M:0;jenkins-hbase4:42815] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:49,779 INFO [M:0;jenkins-hbase4:42815] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:49,779 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:49,780 INFO [M:0;jenkins-hbase4:42815] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42815 2023-02-16 09:00:49,782 DEBUG [M:0;jenkins-hbase4:42815] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42815,1676538043426 already deleted, retry=false 2023-02-16 09:00:49,836 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:49,836 INFO [RS:1;jenkins-hbase4:40519] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40519,1676538043503; zookeeper connection closed. 2023-02-16 09:00:49,836 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68208ac3 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,837 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1005c5c45cf0002, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:49,837 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3efa1d73] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3efa1d73 2023-02-16 09:00:49,837 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44ce1dea rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,937 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:49,937 INFO [M:0;jenkins-hbase4:42815] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42815,1676538043426; zookeeper connection closed. 2023-02-16 09:00:49,937 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ca0e32b rejected from java.util.concurrent.ThreadPoolExecutor@589f6c67[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:49,938 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): master:42815-0x1005c5c45cf0000, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:49,938 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77280a0b rejected from java.util.concurrent.ThreadPoolExecutor@589f6c67[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:50,037 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:50,037 INFO [RS:0;jenkins-hbase4:36163] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36163,1676538043474; zookeeper connection closed. 2023-02-16 09:00:50,037 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2579220a rejected from java.util.concurrent.ThreadPoolExecutor@1125352c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:50,037 DEBUG [Listener at localhost/37905-EventThread] zookeeper.ZKWatcher(600): regionserver:36163-0x1005c5c45cf0001, quorum=127.0.0.1:57407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:50,037 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d40b153] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d40b153 2023-02-16 09:00:50,037 ERROR [Listener at localhost/37905-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d8d6827 rejected from java.util.concurrent.ThreadPoolExecutor@1125352c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:50,037 INFO [Listener at localhost/37905] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:50,038 WARN [Listener at localhost/37905] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:50,042 INFO [Listener at localhost/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:50,152 WARN [BP-2133795050-172.31.14.131-1676538042800 heartbeating to localhost/127.0.0.1:38441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:50,152 WARN [BP-2133795050-172.31.14.131-1676538042800 heartbeating to localhost/127.0.0.1:38441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2133795050-172.31.14.131-1676538042800 (Datanode Uuid f0f78a9f-be56-4dbc-9173-38f3be9c7f65) service to localhost/127.0.0.1:38441 2023-02-16 09:00:50,153 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/dfs/data/data3/current/BP-2133795050-172.31.14.131-1676538042800] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:50,153 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/dfs/data/data4/current/BP-2133795050-172.31.14.131-1676538042800] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:50,155 WARN [Listener at localhost/37905] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:50,158 INFO [Listener at localhost/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:50,264 WARN [BP-2133795050-172.31.14.131-1676538042800 heartbeating to localhost/127.0.0.1:38441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:50,265 WARN [BP-2133795050-172.31.14.131-1676538042800 heartbeating to localhost/127.0.0.1:38441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2133795050-172.31.14.131-1676538042800 (Datanode Uuid bd7c1801-fa10-4a34-bd47-1607c9b8d903) service to localhost/127.0.0.1:38441 2023-02-16 09:00:50,265 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/dfs/data/data1/current/BP-2133795050-172.31.14.131-1676538042800] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:50,266 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/cluster_12d2077c-7f12-a6c3-6caf-70eaf87eb99f/dfs/data/data2/current/BP-2133795050-172.31.14.131-1676538042800] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:50,282 INFO [Listener at localhost/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:50,401 INFO [Listener at localhost/37905] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:00:50,439 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:00:50,454 INFO [Listener at localhost/37905] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38441 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:38441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42815,1676538043426)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38441 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:38441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37905.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=638 (was 575) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 257) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1486 (was 1683) 2023-02-16 09:00:50,465 INFO [Listener at localhost/37905] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=170, AvailableMemoryMB=1486 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.log.dir so I do NOT create it in target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1 2023-02-16 09:00:50,476 WARN [Listener at localhost/37905] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.tmp.dir so I do NOT create it in target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1 2023-02-16 09:00:50,476 WARN [Listener at localhost/37905] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5da51092-4a88-16a7-fa18-fd7949a5be73/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:00:50,476 DEBUG [Listener at localhost/37905] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b, deleteOnExit=true 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/test.cache.data in system properties and HBase conf 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:50,476 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:50,477 DEBUG [Listener at localhost/37905] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:50,477 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:50,478 INFO [Listener at localhost/37905] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:50,482 WARN [Listener at localhost/37905] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:50,482 WARN [Listener at localhost/37905] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:50,554 WARN [Listener at localhost/37905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:50,556 INFO [Listener at localhost/37905] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:50,565 INFO [Listener at localhost/37905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/java.io.tmpdir/Jetty_localhost_36987_hdfs____.eb2gm9/webapp 2023-02-16 09:00:50,660 INFO [Listener at localhost/37905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36987 2023-02-16 09:00:50,665 WARN [Listener at localhost/37905] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:50,665 WARN [Listener at localhost/37905] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:50,717 WARN [Listener at localhost/33181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:50,733 WARN [Listener at localhost/33181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:50,737 WARN [Listener at localhost/33181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:50,738 INFO [Listener at localhost/33181] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:50,745 INFO [Listener at localhost/33181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/java.io.tmpdir/Jetty_localhost_39703_datanode____3pen23/webapp 2023-02-16 09:00:50,846 INFO [Listener at localhost/33181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39703 2023-02-16 09:00:50,854 WARN [Listener at localhost/34567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:50,871 WARN [Listener at localhost/34567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:50,873 WARN [Listener at localhost/34567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:50,874 INFO [Listener at localhost/34567] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:50,877 INFO [Listener at localhost/34567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/java.io.tmpdir/Jetty_localhost_32909_datanode____cj0hii/webapp 2023-02-16 09:00:50,949 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ef0f4dfdac8f675: Processing first storage report for DS-54eff3ba-afcb-448f-b851-821c3b421a20 from datanode d4e07722-07fc-448a-b7e6-5acdf90a8d15 2023-02-16 09:00:50,949 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ef0f4dfdac8f675: from storage DS-54eff3ba-afcb-448f-b851-821c3b421a20 node DatanodeRegistration(127.0.0.1:33175, datanodeUuid=d4e07722-07fc-448a-b7e6-5acdf90a8d15, infoPort=35389, infoSecurePort=0, ipcPort=34567, storageInfo=lv=-57;cid=testClusterID;nsid=955524017;c=1676538050518), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:50,949 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ef0f4dfdac8f675: Processing first storage report for DS-5314eeb0-78b7-4c6c-a220-d5b6ac7f6665 from datanode d4e07722-07fc-448a-b7e6-5acdf90a8d15 2023-02-16 09:00:50,949 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ef0f4dfdac8f675: from storage DS-5314eeb0-78b7-4c6c-a220-d5b6ac7f6665 node DatanodeRegistration(127.0.0.1:33175, datanodeUuid=d4e07722-07fc-448a-b7e6-5acdf90a8d15, infoPort=35389, infoSecurePort=0, ipcPort=34567, storageInfo=lv=-57;cid=testClusterID;nsid=955524017;c=1676538050518), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:50,973 INFO [Listener at localhost/34567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32909 2023-02-16 09:00:50,979 WARN [Listener at localhost/45095] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:51,075 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x996e9bc71a0af77f: Processing first storage report for DS-b5953376-b7ed-48fc-a448-985d71817901 from datanode 9273313d-f0c3-4892-9048-fd16c1b07ac4 2023-02-16 09:00:51,075 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x996e9bc71a0af77f: from storage DS-b5953376-b7ed-48fc-a448-985d71817901 node DatanodeRegistration(127.0.0.1:32945, datanodeUuid=9273313d-f0c3-4892-9048-fd16c1b07ac4, infoPort=33547, infoSecurePort=0, ipcPort=45095, storageInfo=lv=-57;cid=testClusterID;nsid=955524017;c=1676538050518), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:51,075 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x996e9bc71a0af77f: Processing first storage report for DS-05e8259b-dc0d-4c10-bc38-3cde02369fde from datanode 9273313d-f0c3-4892-9048-fd16c1b07ac4 2023-02-16 09:00:51,075 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x996e9bc71a0af77f: from storage DS-05e8259b-dc0d-4c10-bc38-3cde02369fde node DatanodeRegistration(127.0.0.1:32945, datanodeUuid=9273313d-f0c3-4892-9048-fd16c1b07ac4, infoPort=33547, infoSecurePort=0, ipcPort=45095, storageInfo=lv=-57;cid=testClusterID;nsid=955524017;c=1676538050518), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:51,085 DEBUG [Listener at localhost/45095] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1 2023-02-16 09:00:51,087 INFO [Listener at localhost/45095] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/zookeeper_0, clientPort=53789, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:51,088 INFO [Listener at localhost/45095] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53789 2023-02-16 09:00:51,088 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,089 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,103 INFO [Listener at localhost/45095] util.FSUtils(479): Created version file at hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0 with version=8 2023-02-16 09:00:51,104 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,104 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,105 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/hbase-staging 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:51,107 INFO [Listener at localhost/45095] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:51,108 INFO [Listener at localhost/45095] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35845 2023-02-16 09:00:51,108 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,109 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,110 INFO [Listener at localhost/45095] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35845 connecting to ZooKeeper ensemble=127.0.0.1:53789 2023-02-16 09:00:51,117 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:358450x0, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:51,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35845-0x1005c5c63d30000 connected 2023-02-16 09:00:51,129 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:51,130 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:51,130 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:51,130 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35845 2023-02-16 09:00:51,130 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35845 2023-02-16 09:00:51,131 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35845 2023-02-16 09:00:51,131 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35845 2023-02-16 09:00:51,131 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35845 2023-02-16 09:00:51,131 INFO [Listener at localhost/45095] master.HMaster(444): hbase.rootdir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0, hbase.cluster.distributed=false 2023-02-16 09:00:51,143 INFO [Listener at localhost/45095] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:51,144 INFO [Listener at localhost/45095] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:51,145 INFO [Listener at localhost/45095] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37479 2023-02-16 09:00:51,146 INFO [Listener at localhost/45095] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:51,151 DEBUG [Listener at localhost/45095] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:51,152 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,153 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,153 INFO [Listener at localhost/45095] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37479 connecting to ZooKeeper ensemble=127.0.0.1:53789 2023-02-16 09:00:51,156 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:374790x0, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:51,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37479-0x1005c5c63d30001 connected 2023-02-16 09:00:51,158 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:51,158 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:51,159 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:51,159 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37479 2023-02-16 09:00:51,159 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37479 2023-02-16 09:00:51,159 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37479 2023-02-16 09:00:51,160 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37479 2023-02-16 09:00:51,160 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37479 2023-02-16 09:00:51,170 INFO [Listener at localhost/45095] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:51,171 INFO [Listener at localhost/45095] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41557 2023-02-16 09:00:51,172 INFO [Listener at localhost/45095] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:51,173 DEBUG [Listener at localhost/45095] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:51,173 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,174 INFO [Listener at localhost/45095] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,175 INFO [Listener at localhost/45095] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41557 connecting to ZooKeeper ensemble=127.0.0.1:53789 2023-02-16 09:00:51,178 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:415570x0, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:51,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41557-0x1005c5c63d30002 connected 2023-02-16 09:00:51,179 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:51,180 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:51,180 DEBUG [Listener at localhost/45095] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:51,180 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-16 09:00:51,180 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41557 2023-02-16 09:00:51,181 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41557 2023-02-16 09:00:51,181 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-16 09:00:51,181 DEBUG [Listener at localhost/45095] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-16 09:00:51,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,185 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:51,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,186 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:51,186 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:51,186 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,186 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:51,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:51,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:51,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35845,1676538051106 from backup master directory 2023-02-16 09:00:51,191 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,191 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:51,191 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:51,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/hbase.id with ID: dc76dd75-bdab-4402-ba3e-b34c787f2a90 2023-02-16 09:00:51,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:51,211 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x559b98dd to 127.0.0.1:53789 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:51,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ff36016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:51,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:51,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:51,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:51,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store-tmp 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:51,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:51,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:51,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/WALs/jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35845%2C1676538051106, suffix=, logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/WALs/jenkins-hbase4.apache.org,35845,1676538051106, archiveDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:51,245 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK] 2023-02-16 09:00:51,245 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK] 2023-02-16 09:00:51,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/WALs/jenkins-hbase4.apache.org,35845,1676538051106/jenkins-hbase4.apache.org%2C35845%2C1676538051106.1676538051231 2023-02-16 09:00:51,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK], DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK]] 2023-02-16 09:00:51,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:51,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:51,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,249 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,250 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:51,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:51,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:51,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:51,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71383851, jitterRate=0.06370227038860321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:51,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:51,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:00:51,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:51,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:51,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:51,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:51,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:51,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:51,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:51,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:51,270 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:51,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:51,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:51,272 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:51,272 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:51,272 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:51,272 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35845,1676538051106, sessionid=0x1005c5c63d30000, setting cluster-up flag (Was=false) 2023-02-16 09:00:51,278 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:51,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,285 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:51,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:51,290 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/.tmp 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:51,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538081296 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:51,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:51,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:51,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:51,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:51,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:51,310 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:51,310 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:51,311 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:51,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538051309,5,FailOnTimeoutGroup] 2023-02-16 09:00:51,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538051312,5,FailOnTimeoutGroup] 2023-02-16 09:00:51,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:51,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,327 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:51,327 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:51,328 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0 2023-02-16 09:00:51,335 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:51,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:51,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/info 2023-02-16 09:00:51,338 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:51,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:51,340 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:51,340 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:51,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:51,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/table 2023-02-16 09:00:51,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:51,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,343 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740 2023-02-16 09:00:51,343 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740 2023-02-16 09:00:51,345 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:51,346 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:51,349 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67906081, jitterRate=0.011879459023475647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:51,349 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:51,349 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:51,349 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:51,351 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:51,351 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:51,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:51,353 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:51,354 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:51,384 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(952): ClusterId : dc76dd75-bdab-4402-ba3e-b34c787f2a90 2023-02-16 09:00:51,384 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:51,385 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(952): ClusterId : dc76dd75-bdab-4402-ba3e-b34c787f2a90 2023-02-16 09:00:51,385 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:51,387 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:51,387 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:51,387 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:51,387 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:51,390 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:51,392 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:51,394 DEBUG [RS:0;jenkins-hbase4:37479] zookeeper.ReadOnlyZKClient(139): Connect 0x2b459234 to 127.0.0.1:53789 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:51,394 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ReadOnlyZKClient(139): Connect 0x2289566d to 127.0.0.1:53789 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:51,408 DEBUG [RS:0;jenkins-hbase4:37479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2582792c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:51,408 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c4ebc4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:51,408 DEBUG [RS:0;jenkins-hbase4:37479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21bdf944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:51,409 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28713d1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:51,417 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41557 2023-02-16 09:00:51,417 INFO [RS:1;jenkins-hbase4:41557] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:51,417 INFO [RS:1;jenkins-hbase4:41557] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:51,418 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:51,418 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35845,1676538051106 with isa=jenkins-hbase4.apache.org/172.31.14.131:41557, startcode=1676538051170 2023-02-16 09:00:51,418 DEBUG [RS:1;jenkins-hbase4:41557] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:51,420 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33767, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:51,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,422 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37479 2023-02-16 09:00:51,422 INFO [RS:0;jenkins-hbase4:37479] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:51,422 INFO [RS:0;jenkins-hbase4:37479] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:51,422 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:51,422 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0 2023-02-16 09:00:51,422 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33181 2023-02-16 09:00:51,422 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:51,422 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35845,1676538051106 with isa=jenkins-hbase4.apache.org/172.31.14.131:37479, startcode=1676538051143 2023-02-16 09:00:51,423 DEBUG [RS:0;jenkins-hbase4:37479] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:51,424 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49127, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:51,424 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:51,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,424 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,425 WARN [RS:1;jenkins-hbase4:41557] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:51,425 INFO [RS:1;jenkins-hbase4:41557] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:51,425 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0 2023-02-16 09:00:51,425 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,425 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33181 2023-02-16 09:00:51,426 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41557,1676538051170] 2023-02-16 09:00:51,426 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:51,429 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:51,430 DEBUG [RS:0;jenkins-hbase4:37479] zookeeper.ZKUtil(162): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,430 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37479,1676538051143] 2023-02-16 09:00:51,430 WARN [RS:0;jenkins-hbase4:37479] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:51,430 INFO [RS:0;jenkins-hbase4:37479] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:51,430 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,435 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,436 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,437 DEBUG [RS:0;jenkins-hbase4:37479] zookeeper.ZKUtil(162): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,437 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:51,437 DEBUG [RS:0;jenkins-hbase4:37479] zookeeper.ZKUtil(162): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,437 INFO [RS:1;jenkins-hbase4:41557] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:51,438 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:51,438 INFO [RS:0;jenkins-hbase4:37479] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:51,438 INFO [RS:1;jenkins-hbase4:41557] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:51,438 INFO [RS:1;jenkins-hbase4:41557] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:51,439 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,439 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:51,439 INFO [RS:0;jenkins-hbase4:37479] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:51,440 INFO [RS:0;jenkins-hbase4:37479] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:51,440 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,441 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:51,441 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,442 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,443 DEBUG [RS:0;jenkins-hbase4:37479] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:51,446 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,446 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,446 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,446 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,446 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,447 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,457 INFO [RS:0;jenkins-hbase4:37479] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:51,458 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37479,1676538051143-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,460 INFO [RS:1;jenkins-hbase4:41557] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:51,461 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41557,1676538051170-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,471 INFO [RS:0;jenkins-hbase4:37479] regionserver.Replication(203): jenkins-hbase4.apache.org,37479,1676538051143 started 2023-02-16 09:00:51,471 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37479,1676538051143, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37479, sessionid=0x1005c5c63d30001 2023-02-16 09:00:51,471 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:51,471 DEBUG [RS:0;jenkins-hbase4:37479] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,471 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37479,1676538051143' 2023-02-16 09:00:51,471 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:51,472 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:51,472 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:51,472 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:51,472 INFO [RS:1;jenkins-hbase4:41557] regionserver.Replication(203): jenkins-hbase4.apache.org,41557,1676538051170 started 2023-02-16 09:00:51,472 DEBUG [RS:0;jenkins-hbase4:37479] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,473 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41557,1676538051170, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41557, sessionid=0x1005c5c63d30002 2023-02-16 09:00:51,473 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37479,1676538051143' 2023-02-16 09:00:51,473 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:51,473 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:51,473 DEBUG [RS:1;jenkins-hbase4:41557] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,473 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41557,1676538051170' 2023-02-16 09:00:51,473 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:51,473 DEBUG [RS:0;jenkins-hbase4:37479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:51,473 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:51,473 DEBUG [RS:0;jenkins-hbase4:37479] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:51,473 INFO [RS:0;jenkins-hbase4:37479] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:51,473 INFO [RS:0;jenkins-hbase4:37479] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41557,1676538051170' 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:51,474 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:51,474 INFO [RS:1;jenkins-hbase4:41557] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:51,474 INFO [RS:1;jenkins-hbase4:41557] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:51,505 DEBUG [jenkins-hbase4:35845] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:51,505 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:51,506 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:51,506 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:51,506 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:51,507 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37479,1676538051143, state=OPENING 2023-02-16 09:00:51,509 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:51,511 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:51,511 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:51,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37479,1676538051143}] 2023-02-16 09:00:51,668 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,669 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:51,671 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:51,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:51,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:51,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37479%2C1676538051143.meta, suffix=.meta, logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,37479,1676538051143, archiveDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs, maxLogs=32 2023-02-16 09:00:51,689 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK] 2023-02-16 09:00:51,689 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK] 2023-02-16 09:00:51,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,37479,1676538051143/jenkins-hbase4.apache.org%2C37479%2C1676538051143.meta.1676538051677.meta 2023-02-16 09:00:51,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK], DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK]] 2023-02-16 09:00:51,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:51,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:51,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:51,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:51,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/info 2023-02-16 09:00:51,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/info 2023-02-16 09:00:51,695 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:51,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:51,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:51,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:51,696 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:51,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:51,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/table 2023-02-16 09:00:51,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/table 2023-02-16 09:00:51,697 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:51,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:51,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740 2023-02-16 09:00:51,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740 2023-02-16 09:00:51,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:51,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:51,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72344394, jitterRate=0.07801547646522522}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:51,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:51,702 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538051668 2023-02-16 09:00:51,705 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:51,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:51,706 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37479,1676538051143, state=OPEN 2023-02-16 09:00:51,707 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:51,707 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:51,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:51,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37479,1676538051143 in 196 msec 2023-02-16 09:00:51,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:51,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-16 09:00:51,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 419 msec 2023-02-16 09:00:51,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538051711, completionTime=-1 2023-02-16 09:00:51,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:51,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:51,713 DEBUG [hconnection-0x66710404-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:51,714 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:51,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:51,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538111716 2023-02-16 09:00:51,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538171716 2023-02-16 09:00:51,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 09:00:51,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1676538051106-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1676538051106-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1676538051106-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35845, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:51,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:51,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:51,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:51,725 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:51,725 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:51,725 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:51,726 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:51,727 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139 empty. 2023-02-16 09:00:51,727 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:51,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:51,735 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:51,736 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fe117418824abcfa3ec3fb0a3c2ea139, NAME => 'hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp 2023-02-16 09:00:51,741 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:51,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fe117418824abcfa3ec3fb0a3c2ea139, disabling compactions & flushes 2023-02-16 09:00:51,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:51,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:51,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. after waiting 0 ms 2023-02-16 09:00:51,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:51,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:51,742 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fe117418824abcfa3ec3fb0a3c2ea139: 2023-02-16 09:00:51,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:51,744 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538051744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538051744"}]},"ts":"1676538051744"} 2023-02-16 09:00:51,746 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:51,747 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:51,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538051747"}]},"ts":"1676538051747"} 2023-02-16 09:00:51,748 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:51,750 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:51,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:51,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:51,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:51,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fe117418824abcfa3ec3fb0a3c2ea139, ASSIGN}] 2023-02-16 09:00:51,753 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fe117418824abcfa3ec3fb0a3c2ea139, ASSIGN 2023-02-16 09:00:51,753 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fe117418824abcfa3ec3fb0a3c2ea139, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37479,1676538051143; forceNewPlan=false, retain=false 2023-02-16 09:00:51,904 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:51,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fe117418824abcfa3ec3fb0a3c2ea139, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:51,904 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538051904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538051904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538051904"}]},"ts":"1676538051904"} 2023-02-16 09:00:51,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fe117418824abcfa3ec3fb0a3c2ea139, server=jenkins-hbase4.apache.org,37479,1676538051143}] 2023-02-16 09:00:52,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:52,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37479%2C1676538051143, suffix=, logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,37479,1676538051143, archiveDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs, maxLogs=32 2023-02-16 09:00:52,076 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK] 2023-02-16 09:00:52,076 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK] 2023-02-16 09:00:52,078 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,37479,1676538051143/jenkins-hbase4.apache.org%2C37479%2C1676538051143.1676538052062 2023-02-16 09:00:52,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK], DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK]] 2023-02-16 09:00:52,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe117418824abcfa3ec3fb0a3c2ea139, NAME => 'hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:52,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:52,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,080 INFO [StoreOpener-fe117418824abcfa3ec3fb0a3c2ea139-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,081 DEBUG [StoreOpener-fe117418824abcfa3ec3fb0a3c2ea139-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/info 2023-02-16 09:00:52,081 DEBUG [StoreOpener-fe117418824abcfa3ec3fb0a3c2ea139-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/info 2023-02-16 09:00:52,081 INFO [StoreOpener-fe117418824abcfa3ec3fb0a3c2ea139-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe117418824abcfa3ec3fb0a3c2ea139 columnFamilyName info 2023-02-16 09:00:52,081 INFO [StoreOpener-fe117418824abcfa3ec3fb0a3c2ea139-1] regionserver.HStore(310): Store=fe117418824abcfa3ec3fb0a3c2ea139/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:52,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:52,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:52,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fe117418824abcfa3ec3fb0a3c2ea139; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71671805, jitterRate=0.06799311935901642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:52,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fe117418824abcfa3ec3fb0a3c2ea139: 2023-02-16 09:00:52,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139., pid=6, masterSystemTime=1676538052057 2023-02-16 09:00:52,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:52,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:52,089 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fe117418824abcfa3ec3fb0a3c2ea139, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:52,089 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538052089"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538052089"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538052089"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538052089"}]},"ts":"1676538052089"} 2023-02-16 09:00:52,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:52,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fe117418824abcfa3ec3fb0a3c2ea139, server=jenkins-hbase4.apache.org,37479,1676538051143 in 184 msec 2023-02-16 09:00:52,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:52,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fe117418824abcfa3ec3fb0a3c2ea139, ASSIGN in 340 msec 2023-02-16 09:00:52,093 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:52,093 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538052093"}]},"ts":"1676538052093"} 2023-02-16 09:00:52,094 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:52,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:52,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-16 09:00:52,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:52,127 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:52,127 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:52,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:52,137 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:52,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 09:00:52,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:52,146 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:52,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-16 09:00:52,154 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:52,157 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.966sec 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1676538051106-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:52,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1676538051106-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:52,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:52,184 DEBUG [Listener at localhost/45095] zookeeper.ReadOnlyZKClient(139): Connect 0x20315664 to 127.0.0.1:53789 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:52,190 DEBUG [Listener at localhost/45095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c8ba4c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:52,192 DEBUG [hconnection-0x52ec3b5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:52,193 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44136, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:52,194 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:52,195 DEBUG [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:52,196 DEBUG [Listener at localhost/45095] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:52,197 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:52,198 INFO [Listener at localhost/45095] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:56910 deadline: 1676538112198, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,199 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-16 09:00:52,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:52,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:52,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-16 09:00:52,203 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:52,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:52,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe empty. 2023-02-16 09:00:52,205 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,205 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 09:00:52,212 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:52,213 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9e2b44add3ba62c6e449b0f301ffbfe, NAME => 'testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp 2023-02-16 09:00:52,218 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:52,218 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing c9e2b44add3ba62c6e449b0f301ffbfe, disabling compactions & flushes 2023-02-16 09:00:52,218 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,218 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,218 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. after waiting 0 ms 2023-02-16 09:00:52,218 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,218 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,219 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:52,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:52,221 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676538052221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538052221"}]},"ts":"1676538052221"} 2023-02-16 09:00:52,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:52,223 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:52,223 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538052223"}]},"ts":"1676538052223"} 2023-02-16 09:00:52,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-16 09:00:52,227 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:52,228 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:52,228 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:52,228 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:52,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, ASSIGN}] 2023-02-16 09:00:52,233 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, ASSIGN 2023-02-16 09:00:52,234 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676538051170; forceNewPlan=false, retain=false 2023-02-16 09:00:52,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:52,384 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:52,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9e2b44add3ba62c6e449b0f301ffbfe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676538052384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538052384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538052384"}]},"ts":"1676538052384"} 2023-02-16 09:00:52,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure c9e2b44add3ba62c6e449b0f301ffbfe, server=jenkins-hbase4.apache.org,41557,1676538051170}] 2023-02-16 09:00:52,476 INFO [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41557%2C1676538051170, suffix=, logDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,41557,1676538051170, archiveDir=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs, maxLogs=32 2023-02-16 09:00:52,490 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK] 2023-02-16 09:00:52,490 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK] 2023-02-16 09:00:52,492 INFO [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/WALs/jenkins-hbase4.apache.org,41557,1676538051170/jenkins-hbase4.apache.org%2C41557%2C1676538051170.1676538052476 2023-02-16 09:00:52,492 DEBUG [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33175,DS-54eff3ba-afcb-448f-b851-821c3b421a20,DISK], DatanodeInfoWithStorage[127.0.0.1:32945,DS-b5953376-b7ed-48fc-a448-985d71817901,DISK]] 2023-02-16 09:00:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:52,539 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,539 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:52,541 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:52,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9e2b44add3ba62c6e449b0f301ffbfe, NAME => 'testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,545 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,546 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1 2023-02-16 09:00:52,546 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1 2023-02-16 09:00:52,546 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e2b44add3ba62c6e449b0f301ffbfe columnFamilyName f1 2023-02-16 09:00:52,547 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(310): Store=c9e2b44add3ba62c6e449b0f301ffbfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:52,547 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,548 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2 2023-02-16 09:00:52,548 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2 2023-02-16 09:00:52,548 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e2b44add3ba62c6e449b0f301ffbfe columnFamilyName f2 2023-02-16 09:00:52,549 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(310): Store=c9e2b44add3ba62c6e449b0f301ffbfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:52,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:52,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:52,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:52,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9e2b44add3ba62c6e449b0f301ffbfe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73443016, jitterRate=0.09438621997833252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:52,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:52,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe., pid=12, masterSystemTime=1676538052539 2023-02-16 09:00:52,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,564 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9e2b44add3ba62c6e449b0f301ffbfe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,564 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676538052564"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538052564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538052564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538052564"}]},"ts":"1676538052564"} 2023-02-16 09:00:52,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 09:00:52,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure c9e2b44add3ba62c6e449b0f301ffbfe, server=jenkins-hbase4.apache.org,41557,1676538051170 in 178 msec 2023-02-16 09:00:52,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 09:00:52,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, ASSIGN in 338 msec 2023-02-16 09:00:52,569 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:52,569 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538052569"}]},"ts":"1676538052569"} 2023-02-16 09:00:52,570 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-16 09:00:52,573 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:52,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 372 msec 2023-02-16 09:00:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:52,807 INFO [Listener at localhost/45095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-16 09:00:52,808 DEBUG [Listener at localhost/45095] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-16 09:00:52,808 INFO [Listener at localhost/45095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:52,810 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-16 09:00:52,810 INFO [Listener at localhost/45095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:52,810 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-16 09:00:52,810 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:52,826 DEBUG [hconnection-0x52ec3b5b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:52,845 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:52,853 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,939 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:52,939 INFO [Listener at localhost/45095] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:52,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 09:00:52,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538052940 (current time:1676538052940). 2023-02-16 09:00:52,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:52,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x73606202 to 127.0.0.1:53789 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:52,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2192ddba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:52,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:52,948 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73606202 to 127.0.0.1:53789 2023-02-16 09:00:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:52,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:52,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 09:00:52,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 09:00:52,954 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 09:00:52,954 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676538652954 2023-02-16 09:00:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 09:00:52,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,957 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 09:00:52,957 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:52,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 09:00:52,958 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:52,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-16 09:00:52,959 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 09:00:52,960 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676538652960 2023-02-16 09:00:52,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,972 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 09:00:52,972 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:52,973 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 09:00:52,973 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 09:00:52,974 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,974 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,975 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:52,975 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:52,975 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:52,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:52,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:52,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:52,975 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,975 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 09:00:52,976 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 09:00:52,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,977 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 09:00:52,977 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:52,978 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:00:52,978 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 09:00:52,978 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 09:00:52,978 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:52,978 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41557,1676538051170' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 09:00:52,979 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:00:52,979 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 09:00:52,979 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37479,1676538051143' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 09:00:52,981 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,981 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:52,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:52,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:52,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:52,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41557,1676538051170' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 09:00:52,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4701449[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:52,984 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 09:00:52,984 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,985 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,985 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:00:52,985 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:52,985 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:52,985 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 09:00:52,985 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:52,985 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:52,985 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. started... 2023-02-16 09:00:52,985 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c9e2b44add3ba62c6e449b0f301ffbfe 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 09:00:52,987 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:52,987 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:00:52,987 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 09:00:52,987 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37479,1676538051143' in zk 2023-02-16 09:00:52,989 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:00:52,989 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:52,989 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 09:00:53,001 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f1/9ac7200098704d69aced18248735bbaa 2023-02-16 09:00:53,024 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f2/7127b36fea0b45638ae195fdce2ff5af 2023-02-16 09:00:53,027 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f1/9ac7200098704d69aced18248735bbaa as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa 2023-02-16 09:00:53,031 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:53,031 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f2/7127b36fea0b45638ae195fdce2ff5af as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af 2023-02-16 09:00:53,035 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:53,036 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for c9e2b44add3ba62c6e449b0f301ffbfe in 51ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa] hfiles 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af] hfiles 2023-02-16 09:00:53,036 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,041 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. completed. 2023-02-16 09:00:53,042 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 09:00:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 09:00:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 09:00:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41557,1676538051170' in zk 2023-02-16 09:00:53,043 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:00:53,043 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,043 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:53,043 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 09:00:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41557,1676538051170': 2023-02-16 09:00:53,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41557,1676538051170' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:53,046 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 09:00:53,046 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:53,046 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:53,046 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,046 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:53,047 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,047 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:53,047 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,047 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,048 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:53,048 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:53,048 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,050 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:53,050 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,058 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:53,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:53,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:53,059 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:53,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:53,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:53,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:53,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:53,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,061 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,062 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,092 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-16 09:00:53,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,093 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676538052955Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676538053061 (+106 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676538053061Writing data manifest for testWithMockedMapReduceSingleRegion at 1676538053064 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676538053070 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676538053092 (+22 ms) 2023-02-16 09:00:53,094 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 09:00:53,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 138 msec 2023-02-16 09:00:53,259 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:53,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 09:00:53,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:53,261 INFO [Listener at localhost/45095] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:53,264 INFO [Listener at localhost/45095] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:53,268 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:53,296 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,376 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:53,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:53,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,385 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 09:00:53,385 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:53,386 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 09:00:53,386 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 09:00:53,387 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,387 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,388 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:53,388 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:53,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:53,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:53,388 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,389 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,389 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,390 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 09:00:53,391 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:53,392 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:00:53,392 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 09:00:53,392 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37479,1676538051143' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 09:00:53,392 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 09:00:53,392 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:00:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 09:00:53,393 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:53,393 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,393 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. started... 2023-02-16 09:00:53,393 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c9e2b44add3ba62c6e449b0f301ffbfe 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 09:00:53,394 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,395 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,395 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:53,411 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f1/023691b727c04e8c8f3b95b434aba66e 2023-02-16 09:00:53,429 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f2/b96864de70dc4e34b5b4ea395ad66fab 2023-02-16 09:00:53,433 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f1/023691b727c04e8c8f3b95b434aba66e as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/023691b727c04e8c8f3b95b434aba66e 2023-02-16 09:00:53,436 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/023691b727c04e8c8f3b95b434aba66e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:53,437 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/.tmp/f2/b96864de70dc4e34b5b4ea395ad66fab as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/b96864de70dc4e34b5b4ea395ad66fab 2023-02-16 09:00:53,441 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/b96864de70dc4e34b5b4ea395ad66fab, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:53,441 INFO [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for c9e2b44add3ba62c6e449b0f301ffbfe in 48ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:53,442 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,442 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676538051170)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 09:00:53,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 09:00:53,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 09:00:53,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41557,1676538051170' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 09:00:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,445 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:53,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41557,1676538051170' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 09:00:53,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f901f[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:53,447 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 09:00:53,447 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:00:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 09:00:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41557,1676538051170' in zk 2023-02-16 09:00:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:00:53,449 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 09:00:53,449 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37479,1676538051143' in zk 2023-02-16 09:00:53,448 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,449 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:00:53,450 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676538051170' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 09:00:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:00:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,37479,1676538051143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 09:00:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41557,1676538051170': 2023-02-16 09:00:53,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41557,1676538051170' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 09:00:53,453 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 09:00:53,453 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:53,453 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:53,453 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,453 INFO [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:53,460 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:53,460 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:53,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,461 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:53,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,461 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,462 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,463 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,465 DEBUG [(jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:53,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-16 09:00:53,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:53,465 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,466 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,466 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:53,466 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:53,466 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,566 DEBUG [Listener at localhost/45095] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:53,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:53,571 INFO [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676538052940 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:53,571 DEBUG [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058/data/default/testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,572 INFO [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(239): region to add: c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,572 INFO [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(585): clone region=c9e2b44add3ba62c6e449b0f301ffbfe as c9e2b44add3ba62c6e449b0f301ffbfe in snapshot testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,573 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9e2b44add3ba62c6e449b0f301ffbfe, NAME => 'testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058 2023-02-16 09:00:53,579 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:53,579 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ac7200098704d69aced18248735bbaa from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,583 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7127b36fea0b45638ae195fdce2ff5af from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c9e2b44add3ba62c6e449b0f301ffbfe, disabling compactions & flushes 2023-02-16 09:00:53,585 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. after waiting 0 ms 2023-02-16 09:00:53,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,585 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,586 INFO [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676538052940 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:53,586 DEBUG [Listener at localhost/45095] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058 2023-02-16 09:00:53,586 DEBUG [Listener at localhost/45095] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058 2023-02-16 09:00:53,586 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:53,587 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:53,587 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-16 09:00:53,587 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |----------c9e2b44add3ba62c6e449b0f301ffbfe/ 2023-02-16 09:00:53,588 DEBUG [Listener at localhost/45095] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:53,588 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:53,588 DEBUG [Listener at localhost/45095] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=c9e2b44add3ba62c6e449b0f301ffbfe-9ac7200098704d69aced18248735bbaa 2023-02-16 09:00:53,588 DEBUG [Listener at localhost/45095] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:53,589 DEBUG [Listener at localhost/45095] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=c9e2b44add3ba62c6e449b0f301ffbfe-7127b36fea0b45638ae195fdce2ff5af 2023-02-16 09:00:53,592 INFO [Listener at localhost/45095] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 09:00:53,596 DEBUG [Listener at localhost/45095] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:53,596 INFO [Listener at localhost/45095] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:00:53,596 DEBUG [Listener at localhost/45095] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:53,598 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,599 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1 2023-02-16 09:00:53,599 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e2b44add3ba62c6e449b0f301ffbfe columnFamilyName f1 2023-02-16 09:00:53,604 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(539): loaded hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/testWithMockedMapReduceSingleRegion=c9e2b44add3ba62c6e449b0f301ffbfe-9ac7200098704d69aced18248735bbaa 2023-02-16 09:00:53,604 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(310): Store=c9e2b44add3ba62c6e449b0f301ffbfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:53,604 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,605 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2 2023-02-16 09:00:53,605 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e2b44add3ba62c6e449b0f301ffbfe columnFamilyName f2 2023-02-16 09:00:53,609 DEBUG [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(539): loaded hdfs://localhost:33181/user/jenkins/test-data/0514a364-aca9-6768-2053-640505d2e6f1/testWithMockedMapReduceSingleRegion/39123ff1-2b6a-4be6-9589-6ab4ab05b058/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/testWithMockedMapReduceSingleRegion=c9e2b44add3ba62c6e449b0f301ffbfe-7127b36fea0b45638ae195fdce2ff5af 2023-02-16 09:00:53,610 INFO [StoreOpener-c9e2b44add3ba62c6e449b0f301ffbfe-1] regionserver.HStore(310): Store=c9e2b44add3ba62c6e449b0f301ffbfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:53,610 DEBUG [Listener at localhost/45095] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:53,610 INFO [Listener at localhost/45095] regionserver.HRegion(1071): Opened c9e2b44add3ba62c6e449b0f301ffbfe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64382802, jitterRate=-0.04062148928642273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:53,610 DEBUG [Listener at localhost/45095] regionserver.HRegion(964): Region open journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,662 DEBUG [Listener at localhost/45095] regionserver.HRegion(1603): Closing c9e2b44add3ba62c6e449b0f301ffbfe, disabling compactions & flushes 2023-02-16 09:00:53,662 INFO [Listener at localhost/45095] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,662 DEBUG [Listener at localhost/45095] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,662 DEBUG [Listener at localhost/45095] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. after waiting 0 ms 2023-02-16 09:00:53,662 DEBUG [Listener at localhost/45095] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,663 INFO [Listener at localhost/45095] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,663 DEBUG [Listener at localhost/45095] regionserver.HRegion(1557): Region close journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-16 09:00:53,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,671 INFO [Listener at localhost/45095] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:53,675 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538053675"}]},"ts":"1676538053675"} 2023-02-16 09:00:53,676 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-16 09:00:53,678 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-16 09:00:53,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, UNASSIGN}] 2023-02-16 09:00:53,680 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, UNASSIGN 2023-02-16 09:00:53,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9e2b44add3ba62c6e449b0f301ffbfe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:53,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676538053680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538053680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538053680"}]},"ts":"1676538053680"} 2023-02-16 09:00:53,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure c9e2b44add3ba62c6e449b0f301ffbfe, server=jenkins-hbase4.apache.org,41557,1676538051170}] 2023-02-16 09:00:53,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:53,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9e2b44add3ba62c6e449b0f301ffbfe, disabling compactions & flushes 2023-02-16 09:00:53,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. after waiting 0 ms 2023-02-16 09:00:53,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:53,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe. 2023-02-16 09:00:53,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9e2b44add3ba62c6e449b0f301ffbfe: 2023-02-16 09:00:53,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,841 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9e2b44add3ba62c6e449b0f301ffbfe, regionState=CLOSED 2023-02-16 09:00:53,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676538053841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538053841"}]},"ts":"1676538053841"} 2023-02-16 09:00:53,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 09:00:53,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure c9e2b44add3ba62c6e449b0f301ffbfe, server=jenkins-hbase4.apache.org,41557,1676538051170 in 160 msec 2023-02-16 09:00:53,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 09:00:53,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=c9e2b44add3ba62c6e449b0f301ffbfe, UNASSIGN in 166 msec 2023-02-16 09:00:53,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538053845"}]},"ts":"1676538053845"} 2023-02-16 09:00:53,847 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-16 09:00:53,848 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-16 09:00:53,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-16 09:00:53,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:53,978 INFO [Listener at localhost/45095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-16 09:00:53,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:53,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1, FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2, FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/recovered.edits] 2023-02-16 09:00:53,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/023691b727c04e8c8f3b95b434aba66e to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/archive/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/023691b727c04e8c8f3b95b434aba66e 2023-02-16 09:00:53,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/archive/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f1/9ac7200098704d69aced18248735bbaa 2023-02-16 09:00:53,991 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/archive/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/7127b36fea0b45638ae195fdce2ff5af 2023-02-16 09:00:53,992 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/b96864de70dc4e34b5b4ea395ad66fab to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/archive/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/f2/b96864de70dc4e34b5b4ea395ad66fab 2023-02-16 09:00:53,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/recovered.edits/12.seqid to hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/archive/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe/recovered.edits/12.seqid 2023-02-16 09:00:53,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/.tmp/data/default/testWithMockedMapReduceSingleRegion/c9e2b44add3ba62c6e449b0f301ffbfe 2023-02-16 09:00:53,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 09:00:53,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:53,999 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-16 09:00:54,000 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-16 09:00:54,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:54,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-16 09:00:54,001 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538054001"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:54,002 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 09:00:54,002 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9e2b44add3ba62c6e449b0f301ffbfe, NAME => 'testWithMockedMapReduceSingleRegion,,1676538052200.c9e2b44add3ba62c6e449b0f301ffbfe.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 09:00:54,002 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-16 09:00:54,002 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538054002"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:54,003 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-16 09:00:54,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 09:00:54,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-16 09:00:54,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:54,083 INFO [Listener at localhost/45095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-16 09:00:54,083 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:54,083 INFO [Listener at localhost/45095] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:54,084 DEBUG [Listener at localhost/45095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20315664 to 127.0.0.1:53789 2023-02-16 09:00:54,084 DEBUG [Listener at localhost/45095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,084 DEBUG [Listener at localhost/45095] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:54,084 DEBUG [Listener at localhost/45095] util.JVMClusterUtil(257): Found active master hash=259971457, stopped=false 2023-02-16 09:00:54,084 INFO [Listener at localhost/45095] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:54,087 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:54,087 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:54,087 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:54,087 INFO [Listener at localhost/45095] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:54,087 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:54,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:54,088 DEBUG [Listener at localhost/45095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x559b98dd to 127.0.0.1:53789 2023-02-16 09:00:54,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:54,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:54,089 DEBUG [Listener at localhost/45095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,089 INFO [Listener at localhost/45095] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37479,1676538051143' ***** 2023-02-16 09:00:54,089 INFO [Listener at localhost/45095] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:54,089 INFO [Listener at localhost/45095] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41557,1676538051170' ***** 2023-02-16 09:00:54,089 INFO [Listener at localhost/45095] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:54,089 INFO [RS:0;jenkins-hbase4:37479] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:54,089 INFO [RS:0;jenkins-hbase4:37479] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:54,089 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:54,089 INFO [RS:1;jenkins-hbase4:41557] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:54,089 INFO [RS:0;jenkins-hbase4:37479] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:54,090 INFO [RS:1;jenkins-hbase4:41557] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:54,090 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(3304): Received CLOSE for fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:54,090 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:54,090 INFO [RS:1;jenkins-hbase4:41557] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:54,091 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:54,091 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fe117418824abcfa3ec3fb0a3c2ea139, disabling compactions & flushes 2023-02-16 09:00:54,092 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2289566d to 127.0.0.1:53789 2023-02-16 09:00:54,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:54,092 DEBUG [RS:0;jenkins-hbase4:37479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b459234 to 127.0.0.1:53789 2023-02-16 09:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:54,092 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. after waiting 0 ms 2023-02-16 09:00:54,092 DEBUG [RS:0;jenkins-hbase4:37479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:54,092 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41557,1676538051170; all regions closed. 2023-02-16 09:00:54,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fe117418824abcfa3ec3fb0a3c2ea139 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:54,092 INFO [RS:0;jenkins-hbase4:37479] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:54,092 INFO [RS:0;jenkins-hbase4:37479] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:54,092 INFO [RS:0;jenkins-hbase4:37479] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:54,092 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:54,098 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 09:00:54,098 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, fe117418824abcfa3ec3fb0a3c2ea139=hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139.} 2023-02-16 09:00:54,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:54,098 DEBUG [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1505): Waiting on 1588230740, fe117418824abcfa3ec3fb0a3c2ea139 2023-02-16 09:00:54,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:54,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:54,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:54,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:54,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-16 09:00:54,101 DEBUG [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41557%2C1676538051170:(num 1676538052476) 2023-02-16 09:00:54,101 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:54,101 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:54,101 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:54,103 INFO [RS:1;jenkins-hbase4:41557] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41557 2023-02-16 09:00:54,108 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:54,108 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:54,108 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:54,108 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41557,1676538051170 2023-02-16 09:00:54,108 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4852a7ea rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,108 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:54,108 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@659c32b5 rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,110 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41557,1676538051170] 2023-02-16 09:00:54,110 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41557,1676538051170; numProcessing=1 2023-02-16 09:00:54,111 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41557,1676538051170 already deleted, retry=false 2023-02-16 09:00:54,111 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41557,1676538051170 expired; onlineServers=1 2023-02-16 09:00:54,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/.tmp/info/d6a3f3979f424587b96b9a5955f0d341 2023-02-16 09:00:54,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/info/006347ad29444ebeb791a69058861821 2023-02-16 09:00:54,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/.tmp/info/d6a3f3979f424587b96b9a5955f0d341 as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/info/d6a3f3979f424587b96b9a5955f0d341 2023-02-16 09:00:54,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 006347ad29444ebeb791a69058861821 2023-02-16 09:00:54,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/info/d6a3f3979f424587b96b9a5955f0d341, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:54,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fe117418824abcfa3ec3fb0a3c2ea139 in 34ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:54,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/namespace/fe117418824abcfa3ec3fb0a3c2ea139/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:54,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:54,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fe117418824abcfa3ec3fb0a3c2ea139: 2023-02-16 09:00:54,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538051723.fe117418824abcfa3ec3fb0a3c2ea139. 2023-02-16 09:00:54,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/rep_barrier/4d48afe4dcc043df9717e34a6617b039 2023-02-16 09:00:54,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d48afe4dcc043df9717e34a6617b039 2023-02-16 09:00:54,149 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:54,149 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:54,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/table/c28e02a9668f47cca83a0d5ee539f9e3 2023-02-16 09:00:54,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28e02a9668f47cca83a0d5ee539f9e3 2023-02-16 09:00:54,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/info/006347ad29444ebeb791a69058861821 as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/info/006347ad29444ebeb791a69058861821 2023-02-16 09:00:54,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 006347ad29444ebeb791a69058861821 2023-02-16 09:00:54,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/info/006347ad29444ebeb791a69058861821, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 09:00:54,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/rep_barrier/4d48afe4dcc043df9717e34a6617b039 as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/rep_barrier/4d48afe4dcc043df9717e34a6617b039 2023-02-16 09:00:54,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d48afe4dcc043df9717e34a6617b039 2023-02-16 09:00:54,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/rep_barrier/4d48afe4dcc043df9717e34a6617b039, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 09:00:54,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/.tmp/table/c28e02a9668f47cca83a0d5ee539f9e3 as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/table/c28e02a9668f47cca83a0d5ee539f9e3 2023-02-16 09:00:54,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28e02a9668f47cca83a0d5ee539f9e3 2023-02-16 09:00:54,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/table/c28e02a9668f47cca83a0d5ee539f9e3, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 09:00:54,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=21, compaction requested=false 2023-02-16 09:00:54,179 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 09:00:54,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:54,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:54,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:54,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:54,287 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,287 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41557,1676538051170; zookeeper connection closed. 2023-02-16 09:00:54,287 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d3565cc rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,287 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1005c5c63d30002, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,287 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6dcddc99 rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,287 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64c6622c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64c6622c 2023-02-16 09:00:54,298 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37479,1676538051143; all regions closed. 2023-02-16 09:00:54,302 DEBUG [RS:0;jenkins-hbase4:37479] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs 2023-02-16 09:00:54,302 INFO [RS:0;jenkins-hbase4:37479] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37479%2C1676538051143.meta:.meta(num 1676538051677) 2023-02-16 09:00:54,305 DEBUG [RS:0;jenkins-hbase4:37479] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/oldWALs 2023-02-16 09:00:54,305 INFO [RS:0;jenkins-hbase4:37479] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37479%2C1676538051143:(num 1676538052062) 2023-02-16 09:00:54,305 DEBUG [RS:0;jenkins-hbase4:37479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,305 INFO [RS:0;jenkins-hbase4:37479] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:54,305 INFO [RS:0;jenkins-hbase4:37479] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:54,306 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:54,307 INFO [RS:0;jenkins-hbase4:37479] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37479 2023-02-16 09:00:54,312 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37479,1676538051143 2023-02-16 09:00:54,312 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:54,312 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@bcab7bc rejected from java.util.concurrent.ThreadPoolExecutor@ff5321d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,313 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37479,1676538051143] 2023-02-16 09:00:54,313 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37479,1676538051143; numProcessing=2 2023-02-16 09:00:54,314 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37479,1676538051143 already deleted, retry=false 2023-02-16 09:00:54,314 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37479,1676538051143 expired; onlineServers=0 2023-02-16 09:00:54,314 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35845,1676538051106' ***** 2023-02-16 09:00:54,314 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:54,315 DEBUG [M:0;jenkins-hbase4:35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b415cb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:54,315 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35845,1676538051106 2023-02-16 09:00:54,315 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35845,1676538051106; all regions closed. 2023-02-16 09:00:54,315 DEBUG [M:0;jenkins-hbase4:35845] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:54,315 DEBUG [M:0;jenkins-hbase4:35845] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:54,315 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:54,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538051309] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538051309,5,FailOnTimeoutGroup] 2023-02-16 09:00:54,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538051312] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538051312,5,FailOnTimeoutGroup] 2023-02-16 09:00:54,315 DEBUG [M:0;jenkins-hbase4:35845] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:54,317 INFO [M:0;jenkins-hbase4:35845] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:54,317 INFO [M:0;jenkins-hbase4:35845] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:54,317 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:54,317 INFO [M:0;jenkins-hbase4:35845] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:54,317 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:54,317 DEBUG [M:0;jenkins-hbase4:35845] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:54,317 INFO [M:0;jenkins-hbase4:35845] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:54,318 ERROR [M:0;jenkins-hbase4:35845] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:00:54,318 INFO [M:0;jenkins-hbase4:35845] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:54,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:54,318 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:54,318 DEBUG [M:0;jenkins-hbase4:35845] zookeeper.ZKUtil(398): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:54,318 WARN [M:0;jenkins-hbase4:35845] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:54,318 INFO [M:0;jenkins-hbase4:35845] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:54,319 INFO [M:0;jenkins-hbase4:35845] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:54,319 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:54,319 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:54,319 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:54,319 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:54,319 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:54,319 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-16 09:00:54,328 INFO [M:0;jenkins-hbase4:35845] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28759a5d3a67406eb086ab3e5ccab389 2023-02-16 09:00:54,331 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28759a5d3a67406eb086ab3e5ccab389 as hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28759a5d3a67406eb086ab3e5ccab389 2023-02-16 09:00:54,334 INFO [M:0;jenkins-hbase4:35845] regionserver.HStore(1080): Added hdfs://localhost:33181/user/jenkins/test-data/d68e5d88-fc8d-a9fe-5b93-5663ad1624a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28759a5d3a67406eb086ab3e5ccab389, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 09:00:54,335 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-16 09:00:54,336 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:54,336 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:54,338 INFO [M:0;jenkins-hbase4:35845] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:54,338 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:54,338 INFO [M:0;jenkins-hbase4:35845] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35845 2023-02-16 09:00:54,342 DEBUG [M:0;jenkins-hbase4:35845] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35845,1676538051106 already deleted, retry=false 2023-02-16 09:00:54,689 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,689 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35845,1676538051106; zookeeper connection closed. 2023-02-16 09:00:54,689 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2845b3ac rejected from java.util.concurrent.ThreadPoolExecutor@2c7a327c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,690 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): master:35845-0x1005c5c63d30000, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,690 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d86c78d rejected from java.util.concurrent.ThreadPoolExecutor@2c7a327c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,789 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,789 INFO [RS:0;jenkins-hbase4:37479] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37479,1676538051143; zookeeper connection closed. 2023-02-16 09:00:54,789 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25de4385 rejected from java.util.concurrent.ThreadPoolExecutor@ff5321d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,789 DEBUG [Listener at localhost/45095-EventThread] zookeeper.ZKWatcher(600): regionserver:37479-0x1005c5c63d30001, quorum=127.0.0.1:53789, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:54,789 ERROR [Listener at localhost/45095-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d34d76c rejected from java.util.concurrent.ThreadPoolExecutor@ff5321d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:54,791 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@442b2491] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@442b2491 2023-02-16 09:00:54,792 INFO [Listener at localhost/45095] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:54,792 WARN [Listener at localhost/45095] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:54,812 INFO [Listener at localhost/45095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:54,916 WARN [BP-1461729367-172.31.14.131-1676538050518 heartbeating to localhost/127.0.0.1:33181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:54,916 WARN [BP-1461729367-172.31.14.131-1676538050518 heartbeating to localhost/127.0.0.1:33181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1461729367-172.31.14.131-1676538050518 (Datanode Uuid 9273313d-f0c3-4892-9048-fd16c1b07ac4) service to localhost/127.0.0.1:33181 2023-02-16 09:00:54,916 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/dfs/data/data3/current/BP-1461729367-172.31.14.131-1676538050518] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:54,917 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/dfs/data/data4/current/BP-1461729367-172.31.14.131-1676538050518] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:54,918 WARN [Listener at localhost/45095] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:54,921 INFO [Listener at localhost/45095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:54,982 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:00:55,052 WARN [BP-1461729367-172.31.14.131-1676538050518 heartbeating to localhost/127.0.0.1:33181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:55,052 WARN [BP-1461729367-172.31.14.131-1676538050518 heartbeating to localhost/127.0.0.1:33181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1461729367-172.31.14.131-1676538050518 (Datanode Uuid d4e07722-07fc-448a-b7e6-5acdf90a8d15) service to localhost/127.0.0.1:33181 2023-02-16 09:00:55,053 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/dfs/data/data1/current/BP-1461729367-172.31.14.131-1676538050518] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:55,054 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/cluster_d05e180d-d6ef-80c0-7a15-737cb79af99b/dfs/data/data2/current/BP-1461729367-172.31.14.131-1676538050518] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:55,064 INFO [Listener at localhost/45095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:55,179 INFO [Listener at localhost/45095] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:00:55,196 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:00:55,208 INFO [Listener at localhost/45095] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 231) Potentially hanging thread: (jenkins-hbase4.apache.org,35845,1676538051106)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:33181 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/45095 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33181 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45095.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:33181 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:33181 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:33181 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:33181 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:33181 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=655 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 269), ProcessCount=170 (was 170), AvailableMemoryMB=1457 (was 1486) 2023-02-16 09:00:55,218 INFO [Listener at localhost/45095] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=1456 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.log.dir so I do NOT create it in target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7 2023-02-16 09:00:55,229 WARN [Listener at localhost/45095] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.tmp.dir so I do NOT create it in target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7 2023-02-16 09:00:55,229 WARN [Listener at localhost/45095] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f79d05fb-9834-ef77-f11c-013cc5bc30d1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:00:55,229 DEBUG [Listener at localhost/45095] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f, deleteOnExit=true 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/test.cache.data in system properties and HBase conf 2023-02-16 09:00:55,229 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:00:55,230 DEBUG [Listener at localhost/45095] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:55,230 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:00:55,231 INFO [Listener at localhost/45095] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:00:55,235 WARN [Listener at localhost/45095] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:55,235 WARN [Listener at localhost/45095] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:55,277 WARN [Listener at localhost/45095] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:55,279 INFO [Listener at localhost/45095] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:55,285 INFO [Listener at localhost/45095] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/java.io.tmpdir/Jetty_localhost_39199_hdfs____oqwpzp/webapp 2023-02-16 09:00:55,382 INFO [Listener at localhost/45095] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39199 2023-02-16 09:00:55,422 WARN [Listener at localhost/45095] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:00:55,423 WARN [Listener at localhost/45095] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:00:55,461 WARN [Listener at localhost/38953] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:55,479 WARN [Listener at localhost/38953] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:55,481 WARN [Listener at localhost/38953] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:55,482 INFO [Listener at localhost/38953] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:55,488 INFO [Listener at localhost/38953] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/java.io.tmpdir/Jetty_localhost_37709_datanode____.8is6t9/webapp 2023-02-16 09:00:55,589 INFO [Listener at localhost/38953] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37709 2023-02-16 09:00:55,599 WARN [Listener at localhost/39429] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:55,612 WARN [Listener at localhost/39429] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:00:55,613 WARN [Listener at localhost/39429] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:00:55,614 INFO [Listener at localhost/39429] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:00:55,618 INFO [Listener at localhost/39429] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/java.io.tmpdir/Jetty_localhost_44399_datanode____69ug6y/webapp 2023-02-16 09:00:55,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf9ae583f682b595: Processing first storage report for DS-e6f07137-014a-437a-ba4d-2dd7552ed72a from datanode acc28a69-0cea-4943-af5d-eda0cc0bd791 2023-02-16 09:00:55,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf9ae583f682b595: from storage DS-e6f07137-014a-437a-ba4d-2dd7552ed72a node DatanodeRegistration(127.0.0.1:46597, datanodeUuid=acc28a69-0cea-4943-af5d-eda0cc0bd791, infoPort=46243, infoSecurePort=0, ipcPort=39429, storageInfo=lv=-57;cid=testClusterID;nsid=1241563990;c=1676538055238), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:55,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf9ae583f682b595: Processing first storage report for DS-757ea859-9981-4c90-a0be-21817963b985 from datanode acc28a69-0cea-4943-af5d-eda0cc0bd791 2023-02-16 09:00:55,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf9ae583f682b595: from storage DS-757ea859-9981-4c90-a0be-21817963b985 node DatanodeRegistration(127.0.0.1:46597, datanodeUuid=acc28a69-0cea-4943-af5d-eda0cc0bd791, infoPort=46243, infoSecurePort=0, ipcPort=39429, storageInfo=lv=-57;cid=testClusterID;nsid=1241563990;c=1676538055238), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:55,723 INFO [Listener at localhost/39429] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44399 2023-02-16 09:00:55,730 WARN [Listener at localhost/44341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:00:55,814 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fb4ec6646bd78dd: Processing first storage report for DS-71c8de58-83fa-4656-bd04-ce25f1d868ca from datanode 569ea7bf-7050-4088-b9f7-3efd733d046e 2023-02-16 09:00:55,814 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fb4ec6646bd78dd: from storage DS-71c8de58-83fa-4656-bd04-ce25f1d868ca node DatanodeRegistration(127.0.0.1:40575, datanodeUuid=569ea7bf-7050-4088-b9f7-3efd733d046e, infoPort=39219, infoSecurePort=0, ipcPort=44341, storageInfo=lv=-57;cid=testClusterID;nsid=1241563990;c=1676538055238), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:55,814 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fb4ec6646bd78dd: Processing first storage report for DS-3cd49932-f722-4401-b180-d3809c900e07 from datanode 569ea7bf-7050-4088-b9f7-3efd733d046e 2023-02-16 09:00:55,814 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fb4ec6646bd78dd: from storage DS-3cd49932-f722-4401-b180-d3809c900e07 node DatanodeRegistration(127.0.0.1:40575, datanodeUuid=569ea7bf-7050-4088-b9f7-3efd733d046e, infoPort=39219, infoSecurePort=0, ipcPort=44341, storageInfo=lv=-57;cid=testClusterID;nsid=1241563990;c=1676538055238), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:00:55,836 DEBUG [Listener at localhost/44341] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7 2023-02-16 09:00:55,839 INFO [Listener at localhost/44341] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/zookeeper_0, clientPort=51767, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:00:55,840 INFO [Listener at localhost/44341] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51767 2023-02-16 09:00:55,840 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,841 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,855 INFO [Listener at localhost/44341] util.FSUtils(479): Created version file at hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659 with version=8 2023-02-16 09:00:55,855 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,856 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,857 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38953/user/jenkins/test-data/acd384a5-731f-eb5a-9299-cef009381b01/hbase-staging 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:55,860 INFO [Listener at localhost/44341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:55,861 INFO [Listener at localhost/44341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34797 2023-02-16 09:00:55,862 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,863 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,864 INFO [Listener at localhost/44341] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34797 connecting to ZooKeeper ensemble=127.0.0.1:51767 2023-02-16 09:00:55,873 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:347970x0, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:55,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34797-0x1005c5c76630000 connected 2023-02-16 09:00:55,918 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:55,918 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:55,919 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:55,919 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34797 2023-02-16 09:00:55,920 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34797 2023-02-16 09:00:55,920 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34797 2023-02-16 09:00:55,920 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34797 2023-02-16 09:00:55,920 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34797 2023-02-16 09:00:55,921 INFO [Listener at localhost/44341] master.HMaster(444): hbase.rootdir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659, hbase.cluster.distributed=false 2023-02-16 09:00:55,934 INFO [Listener at localhost/44341] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:55,934 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,934 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,935 INFO [Listener at localhost/44341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:55,935 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,935 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:55,935 INFO [Listener at localhost/44341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:55,936 INFO [Listener at localhost/44341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38983 2023-02-16 09:00:55,936 INFO [Listener at localhost/44341] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:55,936 DEBUG [Listener at localhost/44341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:55,937 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,938 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,938 INFO [Listener at localhost/44341] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38983 connecting to ZooKeeper ensemble=127.0.0.1:51767 2023-02-16 09:00:55,940 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:389830x0, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:55,941 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:389830x0, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:55,941 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:389830x0, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:55,941 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:389830x0, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:55,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38983-0x1005c5c76630001 connected 2023-02-16 09:00:55,943 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38983 2023-02-16 09:00:55,944 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38983 2023-02-16 09:00:55,944 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38983 2023-02-16 09:00:55,944 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38983 2023-02-16 09:00:55,944 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38983 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:00:55,955 INFO [Listener at localhost/44341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:00:55,956 INFO [Listener at localhost/44341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42509 2023-02-16 09:00:55,956 INFO [Listener at localhost/44341] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:00:55,957 DEBUG [Listener at localhost/44341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:00:55,957 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,958 INFO [Listener at localhost/44341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,959 INFO [Listener at localhost/44341] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42509 connecting to ZooKeeper ensemble=127.0.0.1:51767 2023-02-16 09:00:55,961 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:425090x0, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:00:55,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42509-0x1005c5c76630002 connected 2023-02-16 09:00:55,962 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:55,962 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:55,962 DEBUG [Listener at localhost/44341] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:00:55,963 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42509 2023-02-16 09:00:55,963 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42509 2023-02-16 09:00:55,963 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42509 2023-02-16 09:00:55,963 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42509 2023-02-16 09:00:55,963 DEBUG [Listener at localhost/44341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42509 2023-02-16 09:00:55,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:55,967 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:55,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:55,969 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:55,969 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:55,969 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:55,969 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:55,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:55,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34797,1676538055859 from backup master directory 2023-02-16 09:00:55,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:00:55,972 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:55,972 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:00:55,972 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:55,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:55,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/hbase.id with ID: b845c479-8d77-4c84-b750-e2b371b1c4a1 2023-02-16 09:00:55,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:00:55,993 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:55,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x05c64468 to 127.0.0.1:51767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:56,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ae3fd42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:56,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:56,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:00:56,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:56,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store-tmp 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:56,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:56,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:56,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/WALs/jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:56,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34797%2C1676538055859, suffix=, logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/WALs/jenkins-hbase4.apache.org,34797,1676538055859, archiveDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/oldWALs, maxLogs=10 2023-02-16 09:00:56,022 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK] 2023-02-16 09:00:56,022 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK] 2023-02-16 09:00:56,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/WALs/jenkins-hbase4.apache.org,34797,1676538055859/jenkins-hbase4.apache.org%2C34797%2C1676538055859.1676538056010 2023-02-16 09:00:56,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK], DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK]] 2023-02-16 09:00:56,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:56,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,025 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,026 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:00:56,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:00:56,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:00:56,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:56,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74324168, jitterRate=0.10751640796661377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:56,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:56,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:00:56,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:00:56,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:00:56,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:00:56,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:00:56,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:00:56,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:00:56,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:00:56,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:00:56,048 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:00:56,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:00:56,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:00:56,050 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:56,050 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:56,050 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:56,050 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34797,1676538055859, sessionid=0x1005c5c76630000, setting cluster-up flag (Was=false) 2023-02-16 09:00:56,055 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:00:56,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:56,062 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:00:56,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:56,067 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/.tmp 2023-02-16 09:00:56,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:56,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:56,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:56,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:56,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:00:56,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:00:56,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:56,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538086071 2023-02-16 09:00:56,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:00:56,072 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:56,072 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:00:56,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:00:56,073 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:00:56,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538056073,5,FailOnTimeoutGroup] 2023-02-16 09:00:56,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538056073,5,FailOnTimeoutGroup] 2023-02-16 09:00:56,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:00:56,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,080 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:56,080 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:56,080 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659 2023-02-16 09:00:56,085 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,086 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:56,087 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/info 2023-02-16 09:00:56,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:56,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:56,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:56,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:56,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:56,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/table 2023-02-16 09:00:56,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:56,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740 2023-02-16 09:00:56,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740 2023-02-16 09:00:56,093 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:56,093 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:56,095 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70643196, jitterRate=0.052665650844573975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:56,095 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:56,095 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:56,095 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:56,096 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:00:56,096 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:00:56,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:00:56,098 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:00:56,099 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:00:56,166 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(952): ClusterId : b845c479-8d77-4c84-b750-e2b371b1c4a1 2023-02-16 09:00:56,166 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(952): ClusterId : b845c479-8d77-4c84-b750-e2b371b1c4a1 2023-02-16 09:00:56,166 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:56,166 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:00:56,168 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:56,169 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:56,168 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:00:56,169 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:00:56,170 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:56,171 DEBUG [RS:1;jenkins-hbase4:42509] zookeeper.ReadOnlyZKClient(139): Connect 0x2928d049 to 127.0.0.1:51767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:56,171 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:00:56,172 DEBUG [RS:0;jenkins-hbase4:38983] zookeeper.ReadOnlyZKClient(139): Connect 0x15f06288 to 127.0.0.1:51767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:56,176 DEBUG [RS:1;jenkins-hbase4:42509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27ef3b1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:56,176 DEBUG [RS:0;jenkins-hbase4:38983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b379e46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:56,176 DEBUG [RS:1;jenkins-hbase4:42509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23d0bb39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:56,176 DEBUG [RS:0;jenkins-hbase4:38983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f0809f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:56,185 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38983 2023-02-16 09:00:56,185 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42509 2023-02-16 09:00:56,185 INFO [RS:0;jenkins-hbase4:38983] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:56,185 INFO [RS:0;jenkins-hbase4:38983] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:56,185 INFO [RS:1;jenkins-hbase4:42509] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:00:56,185 INFO [RS:1;jenkins-hbase4:42509] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:00:56,185 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:56,185 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:00:56,185 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34797,1676538055859 with isa=jenkins-hbase4.apache.org/172.31.14.131:42509, startcode=1676538055954 2023-02-16 09:00:56,185 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34797,1676538055859 with isa=jenkins-hbase4.apache.org/172.31.14.131:38983, startcode=1676538055934 2023-02-16 09:00:56,186 DEBUG [RS:1;jenkins-hbase4:42509] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:56,186 DEBUG [RS:0;jenkins-hbase4:38983] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:00:56,187 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39327, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:56,187 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49861, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:00:56,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,189 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659 2023-02-16 09:00:56,189 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38953 2023-02-16 09:00:56,189 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:56,190 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659 2023-02-16 09:00:56,190 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38953 2023-02-16 09:00:56,190 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:00:56,190 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:56,194 DEBUG [RS:1;jenkins-hbase4:42509] zookeeper.ZKUtil(162): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,194 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42509,1676538055954] 2023-02-16 09:00:56,194 WARN [RS:1;jenkins-hbase4:42509] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:56,194 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38983,1676538055934] 2023-02-16 09:00:56,194 INFO [RS:1;jenkins-hbase4:42509] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:56,194 DEBUG [RS:0;jenkins-hbase4:38983] zookeeper.ZKUtil(162): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,194 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,194 WARN [RS:0;jenkins-hbase4:38983] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:00:56,194 INFO [RS:0;jenkins-hbase4:38983] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:56,195 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,198 DEBUG [RS:1;jenkins-hbase4:42509] zookeeper.ZKUtil(162): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,198 DEBUG [RS:0;jenkins-hbase4:38983] zookeeper.ZKUtil(162): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,199 DEBUG [RS:1;jenkins-hbase4:42509] zookeeper.ZKUtil(162): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,199 DEBUG [RS:0;jenkins-hbase4:38983] zookeeper.ZKUtil(162): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,199 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:56,199 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:00:56,199 INFO [RS:1;jenkins-hbase4:42509] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:56,199 INFO [RS:0;jenkins-hbase4:38983] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:00:56,200 INFO [RS:1;jenkins-hbase4:42509] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:56,201 INFO [RS:1;jenkins-hbase4:42509] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:56,201 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,201 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:56,204 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,204 INFO [RS:0;jenkins-hbase4:38983] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,204 DEBUG [RS:1;jenkins-hbase4:42509] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,205 INFO [RS:0;jenkins-hbase4:38983] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:00:56,205 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,205 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,205 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,206 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,206 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:00:56,207 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,208 DEBUG [RS:0;jenkins-hbase4:38983] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:00:56,209 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,209 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,209 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,218 INFO [RS:1;jenkins-hbase4:42509] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:56,219 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42509,1676538055954-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,220 INFO [RS:0;jenkins-hbase4:38983] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:00:56,220 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38983,1676538055934-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,232 INFO [RS:0;jenkins-hbase4:38983] regionserver.Replication(203): jenkins-hbase4.apache.org,38983,1676538055934 started 2023-02-16 09:00:56,232 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38983,1676538055934, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38983, sessionid=0x1005c5c76630001 2023-02-16 09:00:56,232 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:56,232 DEBUG [RS:0;jenkins-hbase4:38983] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,232 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38983,1676538055934' 2023-02-16 09:00:56,232 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38983,1676538055934' 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:56,233 DEBUG [RS:0;jenkins-hbase4:38983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:56,234 DEBUG [RS:0;jenkins-hbase4:38983] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:56,234 INFO [RS:0;jenkins-hbase4:38983] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:56,234 INFO [RS:0;jenkins-hbase4:38983] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:56,234 INFO [RS:1;jenkins-hbase4:42509] regionserver.Replication(203): jenkins-hbase4.apache.org,42509,1676538055954 started 2023-02-16 09:00:56,234 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42509,1676538055954, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42509, sessionid=0x1005c5c76630002 2023-02-16 09:00:56,234 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:00:56,234 DEBUG [RS:1;jenkins-hbase4:42509] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,234 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42509,1676538055954' 2023-02-16 09:00:56,234 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:56,234 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42509,1676538055954' 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:56,235 DEBUG [RS:1;jenkins-hbase4:42509] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:00:56,235 INFO [RS:1;jenkins-hbase4:42509] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:00:56,235 INFO [RS:1;jenkins-hbase4:42509] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:00:56,249 DEBUG [jenkins-hbase4:34797] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:00:56,249 DEBUG [jenkins-hbase4:34797] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:56,250 DEBUG [jenkins-hbase4:34797] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:56,250 DEBUG [jenkins-hbase4:34797] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:56,250 DEBUG [jenkins-hbase4:34797] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:56,251 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38983,1676538055934, state=OPENING 2023-02-16 09:00:56,253 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:00:56,254 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,254 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:56,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38983,1676538055934}] 2023-02-16 09:00:56,409 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:56,410 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:56,413 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:56,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:00:56,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:00:56,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38983%2C1676538055934.meta, suffix=.meta, logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,38983,1676538055934, archiveDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs, maxLogs=32 2023-02-16 09:00:56,432 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK] 2023-02-16 09:00:56,433 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK] 2023-02-16 09:00:56,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,38983,1676538055934/jenkins-hbase4.apache.org%2C38983%2C1676538055934.meta.1676538056420.meta 2023-02-16 09:00:56,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK], DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK]] 2023-02-16 09:00:56,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:56,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:00:56,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:00:56,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:00:56,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:00:56,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:00:56,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:00:56,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:00:56,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/info 2023-02-16 09:00:56,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/info 2023-02-16 09:00:56,437 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:00:56,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:00:56,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:56,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:00:56,438 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:00:56,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:00:56,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/table 2023-02-16 09:00:56,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/table 2023-02-16 09:00:56,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:00:56,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740 2023-02-16 09:00:56,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740 2023-02-16 09:00:56,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:00:56,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:00:56,444 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63970656, jitterRate=-0.046762943267822266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:00:56,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:00:56,444 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538056409 2023-02-16 09:00:56,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:00:56,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:00:56,448 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38983,1676538055934, state=OPEN 2023-02-16 09:00:56,449 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:00:56,449 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:00:56,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:00:56,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38983,1676538055934 in 195 msec 2023-02-16 09:00:56,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:00:56,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-16 09:00:56,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 385 msec 2023-02-16 09:00:56,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538056453, completionTime=-1 2023-02-16 09:00:56,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:00:56,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:00:56,455 DEBUG [hconnection-0x78815462-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:56,456 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:56,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:00:56,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538116458 2023-02-16 09:00:56,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538176458 2023-02-16 09:00:56,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1676538055859-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1676538055859-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1676538055859-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34797, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:00:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:00:56,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:56,470 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:00:56,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:00:56,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:56,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:56,473 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,473 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462 empty. 2023-02-16 09:00:56,474 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:00:56,482 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:56,483 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8d1b5d60c64ceafb2f90c9cfd0bd5462, NAME => 'hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8d1b5d60c64ceafb2f90c9cfd0bd5462, disabling compactions & flushes 2023-02-16 09:00:56,488 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. after waiting 0 ms 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,488 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,488 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8d1b5d60c64ceafb2f90c9cfd0bd5462: 2023-02-16 09:00:56,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:56,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538056490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538056490"}]},"ts":"1676538056490"} 2023-02-16 09:00:56,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:56,492 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:56,492 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538056492"}]},"ts":"1676538056492"} 2023-02-16 09:00:56,493 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:00:56,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:56,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:56,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:56,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:56,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8d1b5d60c64ceafb2f90c9cfd0bd5462, ASSIGN}] 2023-02-16 09:00:56,499 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8d1b5d60c64ceafb2f90c9cfd0bd5462, ASSIGN 2023-02-16 09:00:56,500 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8d1b5d60c64ceafb2f90c9cfd0bd5462, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42509,1676538055954; forceNewPlan=false, retain=false 2023-02-16 09:00:56,650 INFO [jenkins-hbase4:34797] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:56,651 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8d1b5d60c64ceafb2f90c9cfd0bd5462, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,651 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538056650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538056650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538056650"}]},"ts":"1676538056650"} 2023-02-16 09:00:56,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8d1b5d60c64ceafb2f90c9cfd0bd5462, server=jenkins-hbase4.apache.org,42509,1676538055954}] 2023-02-16 09:00:56,805 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,805 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:00:56,806 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:00:56,810 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42509%2C1676538055954, suffix=, logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,42509,1676538055954, archiveDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs, maxLogs=32 2023-02-16 09:00:56,824 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK] 2023-02-16 09:00:56,824 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK] 2023-02-16 09:00:56,826 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,42509,1676538055954/jenkins-hbase4.apache.org%2C42509%2C1676538055954.1676538056811 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK], DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK]] 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8d1b5d60c64ceafb2f90c9cfd0bd5462, NAME => 'hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,829 INFO [StoreOpener-8d1b5d60c64ceafb2f90c9cfd0bd5462-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,830 DEBUG [StoreOpener-8d1b5d60c64ceafb2f90c9cfd0bd5462-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/info 2023-02-16 09:00:56,830 DEBUG [StoreOpener-8d1b5d60c64ceafb2f90c9cfd0bd5462-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/info 2023-02-16 09:00:56,830 INFO [StoreOpener-8d1b5d60c64ceafb2f90c9cfd0bd5462-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d1b5d60c64ceafb2f90c9cfd0bd5462 columnFamilyName info 2023-02-16 09:00:56,830 INFO [StoreOpener-8d1b5d60c64ceafb2f90c9cfd0bd5462-1] regionserver.HStore(310): Store=8d1b5d60c64ceafb2f90c9cfd0bd5462/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:56,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:56,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:56,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8d1b5d60c64ceafb2f90c9cfd0bd5462; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67960700, jitterRate=0.012693345546722412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:00:56,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8d1b5d60c64ceafb2f90c9cfd0bd5462: 2023-02-16 09:00:56,836 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462., pid=6, masterSystemTime=1676538056805 2023-02-16 09:00:56,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:56,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8d1b5d60c64ceafb2f90c9cfd0bd5462, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:56,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538056840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538056840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538056840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538056840"}]},"ts":"1676538056840"} 2023-02-16 09:00:56,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:00:56,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8d1b5d60c64ceafb2f90c9cfd0bd5462, server=jenkins-hbase4.apache.org,42509,1676538055954 in 189 msec 2023-02-16 09:00:56,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:00:56,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8d1b5d60c64ceafb2f90c9cfd0bd5462, ASSIGN in 345 msec 2023-02-16 09:00:56,844 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:56,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538056844"}]},"ts":"1676538056844"} 2023-02-16 09:00:56,845 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:00:56,848 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:56,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-16 09:00:56,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:00:56,872 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:56,872 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:56,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:56,875 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:56,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:00:56,884 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:56,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 09:00:56,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:00:56,897 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:00:56,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-16 09:00:56,912 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:00:56,915 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:00:56,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.942sec 2023-02-16 09:00:56,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:00:56,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:00:56,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:00:56,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1676538055859-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:00:56,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1676538055859-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:00:56,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:00:56,966 DEBUG [Listener at localhost/44341] zookeeper.ReadOnlyZKClient(139): Connect 0x18200375 to 127.0.0.1:51767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:56,969 DEBUG [Listener at localhost/44341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49133911, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:56,976 DEBUG [hconnection-0x2a5ecea6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:56,979 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:56,980 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:56,980 DEBUG [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:00:56,983 DEBUG [Listener at localhost/44341] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:00:56,984 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:00:56,985 INFO [Listener at localhost/44341] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:56,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:56,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:00:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:60366 deadline: 1676538116985, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:56,986 INFO [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 09:00:56,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:00:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:56,992 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:00:56,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-16 09:00:56,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:00:56,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:56,995 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:56,995 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 empty. 2023-02-16 09:00:56,996 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:56,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 09:00:57,010 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-16 09:00:57,011 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 56aa43d553cf6ae23e8ae0daab3e5468, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp 2023-02-16 09:00:57,021 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:57,021 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 56aa43d553cf6ae23e8ae0daab3e5468, disabling compactions & flushes 2023-02-16 09:00:57,021 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,022 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,022 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. after waiting 0 ms 2023-02-16 09:00:57,022 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,022 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,022 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:57,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:00:57,024 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676538057024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538057024"}]},"ts":"1676538057024"} 2023-02-16 09:00:57,025 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:00:57,026 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:00:57,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538057026"}]},"ts":"1676538057026"} 2023-02-16 09:00:57,027 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-16 09:00:57,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:00:57,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:00:57,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:00:57,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:00:57,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, ASSIGN}] 2023-02-16 09:00:57,038 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, ASSIGN 2023-02-16 09:00:57,039 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42509,1676538055954; forceNewPlan=false, retain=false 2023-02-16 09:00:57,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:57,189 INFO [jenkins-hbase4:34797] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:00:57,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=56aa43d553cf6ae23e8ae0daab3e5468, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676538057189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538057189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538057189"}]},"ts":"1676538057189"} 2023-02-16 09:00:57,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 56aa43d553cf6ae23e8ae0daab3e5468, server=jenkins-hbase4.apache.org,42509,1676538055954}] 2023-02-16 09:00:57,235 INFO [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38983%2C1676538055934, suffix=, logDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,38983,1676538055934, archiveDir=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs, maxLogs=32 2023-02-16 09:00:57,247 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK] 2023-02-16 09:00:57,247 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK] 2023-02-16 09:00:57,249 INFO [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/WALs/jenkins-hbase4.apache.org,38983,1676538055934/jenkins-hbase4.apache.org%2C38983%2C1676538055934.1676538057235 2023-02-16 09:00:57,249 DEBUG [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40575,DS-71c8de58-83fa-4656-bd04-ce25f1d868ca,DISK], DatanodeInfoWithStorage[127.0.0.1:46597,DS-e6f07137-014a-437a-ba4d-2dd7552ed72a,DISK]] 2023-02-16 09:00:57,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:57,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 56aa43d553cf6ae23e8ae0daab3e5468, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:00:57,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:57,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,347 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,348 DEBUG [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1 2023-02-16 09:00:57,349 DEBUG [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1 2023-02-16 09:00:57,349 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56aa43d553cf6ae23e8ae0daab3e5468 columnFamilyName f1 2023-02-16 09:00:57,349 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] regionserver.HStore(310): Store=56aa43d553cf6ae23e8ae0daab3e5468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:57,349 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,350 DEBUG [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2 2023-02-16 09:00:57,350 DEBUG [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2 2023-02-16 09:00:57,350 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56aa43d553cf6ae23e8ae0daab3e5468 columnFamilyName f2 2023-02-16 09:00:57,351 INFO [StoreOpener-56aa43d553cf6ae23e8ae0daab3e5468-1] regionserver.HStore(310): Store=56aa43d553cf6ae23e8ae0daab3e5468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:00:57,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:00:57,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:57,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:00:57,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 56aa43d553cf6ae23e8ae0daab3e5468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73753844, jitterRate=0.0990179181098938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:00:57,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:57,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468., pid=12, masterSystemTime=1676538057343 2023-02-16 09:00:57,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=56aa43d553cf6ae23e8ae0daab3e5468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,357 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676538057357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538057357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538057357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538057357"}]},"ts":"1676538057357"} 2023-02-16 09:00:57,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 09:00:57,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 56aa43d553cf6ae23e8ae0daab3e5468, server=jenkins-hbase4.apache.org,42509,1676538055954 in 167 msec 2023-02-16 09:00:57,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 09:00:57,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, ASSIGN in 324 msec 2023-02-16 09:00:57,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:00:57,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538057361"}]},"ts":"1676538057361"} 2023-02-16 09:00:57,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-16 09:00:57,364 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:00:57,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 376 msec 2023-02-16 09:00:57,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:00:57,598 INFO [Listener at localhost/44341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-16 09:00:57,598 DEBUG [Listener at localhost/44341] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-16 09:00:57,599 INFO [Listener at localhost/44341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:57,600 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-16 09:00:57,601 INFO [Listener at localhost/44341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:00:57,601 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-16 09:00:57,601 INFO [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:00:57,612 DEBUG [hconnection-0x2a5ecea6-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:57,624 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:57,632 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42509] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,709 INFO [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:00:57,709 INFO [Listener at localhost/44341] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:00:57,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 09:00:57,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538057710 (current time:1676538057710). 2023-02-16 09:00:57,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:00:57,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] zookeeper.ReadOnlyZKClient(139): Connect 0x283e195c to 127.0.0.1:51767 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:00:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@84f5a8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:00:57,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:00:57,715 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:00:57,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x283e195c to 127.0.0.1:51767 2023-02-16 09:00:57,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:57,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:00:57,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 09:00:57,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 09:00:57,720 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 09:00:57,720 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676538657720 2023-02-16 09:00:57,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 09:00:57,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:57,721 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:57,721 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:00:57,722 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 09:00:57,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 09:00:57,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-16 09:00:57,724 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 09:00:57,724 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676538657724 2023-02-16 09:00:57,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 09:00:57,736 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 09:00:57,736 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:57,737 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 09:00:57,737 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 09:00:57,737 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,737 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,740 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:57,740 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:57,740 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:57,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:57,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:57,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:57,740 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,740 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:57,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 09:00:57,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 09:00:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 09:00:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 09:00:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 09:00:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:00:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 09:00:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38983,1676538055934' joining acquired barrier for procedure (foo) in zk 2023-02-16 09:00:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 09:00:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 09:00:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42509,1676538055954' joining acquired barrier for procedure (foo) in zk 2023-02-16 09:00:57,744 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,745 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,745 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:57,745 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,745 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:57,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42509,1676538055954' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 09:00:57,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70dadbd7[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:57,747 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 09:00:57,747 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,748 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 09:00:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 09:00:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 09:00:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38983,1676538055934' in zk 2023-02-16 09:00:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 09:00:57,749 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:00:57,749 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,749 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. started... 2023-02-16 09:00:57,749 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 56aa43d553cf6ae23e8ae0daab3e5468 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 09:00:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 09:00:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 09:00:57,762 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f1/299eff5909d44672a314a5bb7b7c4dd9 2023-02-16 09:00:57,780 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f2/3c60e03c585e400abab747e7cd495fd6 2023-02-16 09:00:57,784 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f1/299eff5909d44672a314a5bb7b7c4dd9 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9 2023-02-16 09:00:57,787 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:57,788 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f2/3c60e03c585e400abab747e7cd495fd6 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6 2023-02-16 09:00:57,791 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:00:57,792 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 56aa43d553cf6ae23e8ae0daab3e5468 in 43ms, sequenceid=5, compaction requested=false 2023-02-16 09:00:57,792 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.' region-info for snapshot=foo 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9] hfiles 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9 for snapshot=foo 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6] hfiles 2023-02-16 09:00:57,793 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6 for snapshot=foo 2023-02-16 09:00:57,798 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. completed. 2023-02-16 09:00:57,799 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 09:00:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 09:00:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 09:00:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42509,1676538055954' in zk 2023-02-16 09:00:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 09:00:57,800 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 09:00:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42509,1676538055954': 2023-02-16 09:00:57,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42509,1676538055954' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 09:00:57,803 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 09:00:57,803 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:57,803 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:57,803 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 09:00:57,803 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:00:57,805 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,805 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:57,805 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:57,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:57,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:57,805 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,807 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,807 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:57,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 09:00:57,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:00:57,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:57,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 09:00:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:57,813 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:57,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:00:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 09:00:57,813 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:57,814 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:57,814 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:57,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:57,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:00:57,814 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 09:00:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:00:57,814 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 09:00:57,822 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:57,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 09:00:57,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:00:57,824 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:00:57,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/.tmp/foo to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/foo 2023-02-16 09:00:57,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-16 09:00:57,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:57,843 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.hbase-snapshot/.tmp/foo 2023-02-16 09:00:57,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676538057720Consolidate snapshot: foo at 1676538057813 (+93 ms)Loading Region manifests for foo at 1676538057813Writing data manifest for foo at 1676538057816 (+3 ms)Verifying snapshot: foo at 1676538057824 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676538057843 (+19 ms) 2023-02-16 09:00:57,845 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 09:00:57,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 124 msec 2023-02-16 09:00:58,024 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:00:58,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 09:00:58,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:00:58,025 INFO [Listener at localhost/44341] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:00:58,029 INFO [Listener at localhost/44341] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:00:58,033 INFO [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:00:58,061 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42509] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,335 INFO [Listener at localhost/44341] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:00:58,341 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:00:58,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,343 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 09:00:58,343 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:58,344 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-16 09:00:58,344 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-16 09:00:58,345 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,345 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,347 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:58,347 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:58,347 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:58,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,347 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,347 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:00:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,352 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 09:00:58,352 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:58,352 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 09:00:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:00:58,354 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 09:00:58,355 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 09:00:58,355 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 09:00:58,355 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38983,1676538055934' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 09:00:58,355 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 09:00:58,355 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:00:58,355 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,356 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. started... 2023-02-16 09:00:58,356 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56aa43d553cf6ae23e8ae0daab3e5468 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 09:00:58,356 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,357 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,357 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:58,385 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f1/7cf8148000884865bb4adbaad5f12856 2023-02-16 09:00:58,409 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f2/6514d554d0ad4c36af11cda0ec72b37e 2023-02-16 09:00:58,413 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f1/7cf8148000884865bb4adbaad5f12856 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/7cf8148000884865bb4adbaad5f12856 2023-02-16 09:00:58,417 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/7cf8148000884865bb4adbaad5f12856, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:58,418 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/.tmp/f2/6514d554d0ad4c36af11cda0ec72b37e as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/6514d554d0ad4c36af11cda0ec72b37e 2023-02-16 09:00:58,422 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/6514d554d0ad4c36af11cda0ec72b37e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:00:58,422 INFO [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 56aa43d553cf6ae23e8ae0daab3e5468 in 66ms, sequenceid=9, compaction requested=false 2023-02-16 09:00:58,424 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:58,424 DEBUG [rs(jenkins-hbase4.apache.org,42509,1676538055954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 09:00:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 09:00:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 09:00:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42509,1676538055954' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 09:00:58,426 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:00:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42509,1676538055954' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-16 09:00:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74e55114[Count = 0] remaining members to acquire global barrier 2023-02-16 09:00:58,428 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-16 09:00:58,428 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,429 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 09:00:58,429 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 09:00:58,429 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,38983,1676538055934' in zk 2023-02-16 09:00:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,430 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,430 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:00:58,430 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 09:00:58,430 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 09:00:58,430 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,42509,1676538055954' in zk 2023-02-16 09:00:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 09:00:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,38983,1676538055934' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 09:00:58,433 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,433 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 09:00:58,433 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:58,433 DEBUG [member: 'jenkins-hbase4.apache.org,42509,1676538055954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 09:00:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:58,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,42509,1676538055954': 2023-02-16 09:00:58,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42509,1676538055954' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-16 09:00:58,438 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-16 09:00:58,438 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:00:58,439 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:00:58,439 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,439 INFO [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:00:58,441 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,441 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:58,442 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,441 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:00:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,442 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:00:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,443 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:00:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,444 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:00:58,445 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:00:58,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:58,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 09:00:58,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:58,447 DEBUG [(jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:00:58,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:00:58,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:00:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:00:58,447 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-16 09:00:58,448 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:00:58,548 DEBUG [Listener at localhost/44341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:00:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:00:58,554 INFO [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676538057710 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:58,554 DEBUG [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38953/user/jenkins/test-data/acd384a5-731f-eb5a-9299-cef009381b01/foo/afba893b-b90f-451a-a123-4dc0fe5ab26e/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,554 INFO [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(239): region to add: 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:58,554 INFO [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(585): clone region=56aa43d553cf6ae23e8ae0daab3e5468 as 56aa43d553cf6ae23e8ae0daab3e5468 in snapshot foo 2023-02-16 09:00:58,555 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 56aa43d553cf6ae23e8ae0daab3e5468, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38953/user/jenkins/test-data/acd384a5-731f-eb5a-9299-cef009381b01/foo/afba893b-b90f-451a-a123-4dc0fe5ab26e 2023-02-16 09:00:58,562 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:00:58,563 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 299eff5909d44672a314a5bb7b7c4dd9 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,565 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c60e03c585e400abab747e7cd495fd6 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 56aa43d553cf6ae23e8ae0daab3e5468, disabling compactions & flushes 2023-02-16 09:00:58,566 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. after waiting 0 ms 2023-02-16 09:00:58,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,566 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:58,568 INFO [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676538057710 type: FLUSH version: 2 ttl: 0 2023-02-16 09:00:58,568 DEBUG [Listener at localhost/44341] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38953/user/jenkins/test-data/acd384a5-731f-eb5a-9299-cef009381b01/foo/afba893b-b90f-451a-a123-4dc0fe5ab26e 2023-02-16 09:00:58,568 DEBUG [Listener at localhost/44341] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38953/user/jenkins/test-data/acd384a5-731f-eb5a-9299-cef009381b01/foo/afba893b-b90f-451a-a123-4dc0fe5ab26e 2023-02-16 09:00:58,568 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |-data/ 2023-02-16 09:00:58,569 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |----default/ 2023-02-16 09:00:58,569 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-16 09:00:58,569 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |----------56aa43d553cf6ae23e8ae0daab3e5468/ 2023-02-16 09:00:58,570 DEBUG [Listener at localhost/44341] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:00:58,570 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:00:58,570 DEBUG [Listener at localhost/44341] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=56aa43d553cf6ae23e8ae0daab3e5468-299eff5909d44672a314a5bb7b7c4dd9 2023-02-16 09:00:58,570 DEBUG [Listener at localhost/44341] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:00:58,571 DEBUG [Listener at localhost/44341] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=56aa43d553cf6ae23e8ae0daab3e5468-3c60e03c585e400abab747e7cd495fd6 hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9 hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/7cf8148000884865bb4adbaad5f12856 hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6 hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/6514d554d0ad4c36af11cda0ec72b37e 2023-02-16 09:00:58,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 09:00:58,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 09:00:58,579 INFO [Listener at localhost/44341] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:58,583 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538058583"}]},"ts":"1676538058583"} 2023-02-16 09:00:58,587 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-16 09:00:58,589 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-16 09:00:58,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, UNASSIGN}] 2023-02-16 09:00:58,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, UNASSIGN 2023-02-16 09:00:58,592 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=56aa43d553cf6ae23e8ae0daab3e5468, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:58,592 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676538058592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538058592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538058592"}]},"ts":"1676538058592"} 2023-02-16 09:00:58,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 56aa43d553cf6ae23e8ae0daab3e5468, server=jenkins-hbase4.apache.org,42509,1676538055954}] 2023-02-16 09:00:58,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:58,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 56aa43d553cf6ae23e8ae0daab3e5468, disabling compactions & flushes 2023-02-16 09:00:58,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. after waiting 0 ms 2023-02-16 09:00:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:00:58,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468. 2023-02-16 09:00:58,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 56aa43d553cf6ae23e8ae0daab3e5468: 2023-02-16 09:00:58,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:58,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=56aa43d553cf6ae23e8ae0daab3e5468, regionState=CLOSED 2023-02-16 09:00:58,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676538058756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538058756"}]},"ts":"1676538058756"} 2023-02-16 09:00:58,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 09:00:58,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 56aa43d553cf6ae23e8ae0daab3e5468, server=jenkins-hbase4.apache.org,42509,1676538055954 in 165 msec 2023-02-16 09:00:58,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 09:00:58,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=56aa43d553cf6ae23e8ae0daab3e5468, UNASSIGN in 170 msec 2023-02-16 09:00:58,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538058762"}]},"ts":"1676538058762"} 2023-02-16 09:00:58,763 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-16 09:00:58,765 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-16 09:00:58,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 186 msec 2023-02-16 09:00:58,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:00:58,887 INFO [Listener at localhost/44341] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-16 09:00:58,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,890 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,891 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:58,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:58,895 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1, FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2, FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/recovered.edits] 2023-02-16 09:00:58,899 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9 to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/299eff5909d44672a314a5bb7b7c4dd9 2023-02-16 09:00:58,900 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/7cf8148000884865bb4adbaad5f12856 to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f1/7cf8148000884865bb4adbaad5f12856 2023-02-16 09:00:58,903 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6 to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/3c60e03c585e400abab747e7cd495fd6 2023-02-16 09:00:58,904 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/6514d554d0ad4c36af11cda0ec72b37e to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/f2/6514d554d0ad4c36af11cda0ec72b37e 2023-02-16 09:00:58,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/recovered.edits/12.seqid to hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468/recovered.edits/12.seqid 2023-02-16 09:00:58,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/56aa43d553cf6ae23e8ae0daab3e5468 2023-02-16 09:00:58,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 09:00:58,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,910 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-16 09:00:58,911 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-16 09:00:58,914 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,915 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-16 09:00:58,915 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538058915"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:58,916 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 09:00:58,916 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 56aa43d553cf6ae23e8ae0daab3e5468, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676538056989.56aa43d553cf6ae23e8ae0daab3e5468.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 09:00:58,916 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-16 09:00:58,916 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538058916"}]},"ts":"9223372036854775807"} 2023-02-16 09:00:58,917 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-16 09:00:58,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 09:00:58,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 31 msec 2023-02-16 09:00:58,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34797] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:00:58,993 INFO [Listener at localhost/44341] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-16 09:00:58,993 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:00:58,993 INFO [Listener at localhost/44341] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:00:58,994 DEBUG [Listener at localhost/44341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18200375 to 127.0.0.1:51767 2023-02-16 09:00:58,994 DEBUG [Listener at localhost/44341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:58,994 DEBUG [Listener at localhost/44341] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:00:58,994 DEBUG [Listener at localhost/44341] util.JVMClusterUtil(257): Found active master hash=833910987, stopped=false 2023-02-16 09:00:58,994 INFO [Listener at localhost/44341] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:58,997 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:58,997 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:58,997 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:00:58,997 INFO [Listener at localhost/44341] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:00:58,997 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:58,999 DEBUG [Listener at localhost/44341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05c64468 to 127.0.0.1:51767 2023-02-16 09:00:58,999 DEBUG [Listener at localhost/44341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:58,999 INFO [Listener at localhost/44341] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38983,1676538055934' ***** 2023-02-16 09:00:59,000 INFO [Listener at localhost/44341] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:59,000 INFO [Listener at localhost/44341] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42509,1676538055954' ***** 2023-02-16 09:00:59,000 INFO [Listener at localhost/44341] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:00:59,000 INFO [RS:0;jenkins-hbase4:38983] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:59,000 INFO [RS:0;jenkins-hbase4:38983] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:59,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:59,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:59,000 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:59,000 INFO [RS:0;jenkins-hbase4:38983] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:59,000 INFO [RS:1;jenkins-hbase4:42509] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:00:59,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:00:59,000 INFO [RS:1;jenkins-hbase4:42509] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:00:59,000 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:00:59,001 INFO [RS:1;jenkins-hbase4:42509] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:00:59,000 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:59,002 DEBUG [RS:0;jenkins-hbase4:38983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15f06288 to 127.0.0.1:51767 2023-02-16 09:00:59,002 DEBUG [RS:0;jenkins-hbase4:38983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:59,003 INFO [RS:0;jenkins-hbase4:38983] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:59,003 INFO [RS:0;jenkins-hbase4:38983] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:59,003 INFO [RS:0;jenkins-hbase4:38983] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:59,003 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:00:59,003 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 09:00:59,003 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(3304): Received CLOSE for 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:59,003 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 09:00:59,003 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:59,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:00:59,003 DEBUG [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 09:00:59,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:00:59,003 DEBUG [RS:1;jenkins-hbase4:42509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2928d049 to 127.0.0.1:51767 2023-02-16 09:00:59,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8d1b5d60c64ceafb2f90c9cfd0bd5462, disabling compactions & flushes 2023-02-16 09:00:59,003 DEBUG [RS:1;jenkins-hbase4:42509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:59,003 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 09:00:59,003 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1479): Online Regions={8d1b5d60c64ceafb2f90c9cfd0bd5462=hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462.} 2023-02-16 09:00:59,004 DEBUG [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1505): Waiting on 8d1b5d60c64ceafb2f90c9cfd0bd5462 2023-02-16 09:00:59,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:00:59,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:00:59,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:00:59,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:59,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-16 09:00:59,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:59,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. after waiting 0 ms 2023-02-16 09:00:59,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:59,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8d1b5d60c64ceafb2f90c9cfd0bd5462 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:00:59,009 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:59,014 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:59,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/info/547fc6665b0f4839826945c3d43d0184 2023-02-16 09:00:59,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547fc6665b0f4839826945c3d43d0184 2023-02-16 09:00:59,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/.tmp/info/63835a81121a4fb5bfc45e25c19c4cb5 2023-02-16 09:00:59,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/.tmp/info/63835a81121a4fb5bfc45e25c19c4cb5 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/info/63835a81121a4fb5bfc45e25c19c4cb5 2023-02-16 09:00:59,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/rep_barrier/f0c438bd5b86444a9c9f581a46d30a2b 2023-02-16 09:00:59,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/info/63835a81121a4fb5bfc45e25c19c4cb5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:00:59,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8d1b5d60c64ceafb2f90c9cfd0bd5462 in 48ms, sequenceid=6, compaction requested=false 2023-02-16 09:00:59,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0c438bd5b86444a9c9f581a46d30a2b 2023-02-16 09:00:59,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/namespace/8d1b5d60c64ceafb2f90c9cfd0bd5462/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:00:59,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/table/45f7d62a385c4ae6829dc8f902e99754 2023-02-16 09:00:59,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:59,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8d1b5d60c64ceafb2f90c9cfd0bd5462: 2023-02-16 09:00:59,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538056468.8d1b5d60c64ceafb2f90c9cfd0bd5462. 2023-02-16 09:00:59,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f7d62a385c4ae6829dc8f902e99754 2023-02-16 09:00:59,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/info/547fc6665b0f4839826945c3d43d0184 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/info/547fc6665b0f4839826945c3d43d0184 2023-02-16 09:00:59,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547fc6665b0f4839826945c3d43d0184 2023-02-16 09:00:59,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/info/547fc6665b0f4839826945c3d43d0184, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 09:00:59,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/rep_barrier/f0c438bd5b86444a9c9f581a46d30a2b as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/rep_barrier/f0c438bd5b86444a9c9f581a46d30a2b 2023-02-16 09:00:59,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0c438bd5b86444a9c9f581a46d30a2b 2023-02-16 09:00:59,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/rep_barrier/f0c438bd5b86444a9c9f581a46d30a2b, entries=1, sequenceid=21, filesize=5.1 K 2023-02-16 09:00:59,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/.tmp/table/45f7d62a385c4ae6829dc8f902e99754 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/table/45f7d62a385c4ae6829dc8f902e99754 2023-02-16 09:00:59,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45f7d62a385c4ae6829dc8f902e99754 2023-02-16 09:00:59,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/table/45f7d62a385c4ae6829dc8f902e99754, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 09:00:59,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 82ms, sequenceid=21, compaction requested=false 2023-02-16 09:00:59,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 09:00:59,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:00:59,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:59,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:00:59,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:00:59,203 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38983,1676538055934; all regions closed. 2023-02-16 09:00:59,204 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42509,1676538055954; all regions closed. 2023-02-16 09:00:59,208 DEBUG [RS:1;jenkins-hbase4:42509] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs 2023-02-16 09:00:59,208 INFO [RS:1;jenkins-hbase4:42509] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42509%2C1676538055954:(num 1676538056811) 2023-02-16 09:00:59,208 DEBUG [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs 2023-02-16 09:00:59,208 DEBUG [RS:1;jenkins-hbase4:42509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:59,208 INFO [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38983%2C1676538055934.meta:.meta(num 1676538056420) 2023-02-16 09:00:59,208 INFO [RS:1;jenkins-hbase4:42509] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:59,208 INFO [RS:1;jenkins-hbase4:42509] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:59,208 INFO [RS:1;jenkins-hbase4:42509] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:00:59,208 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:59,208 INFO [RS:1;jenkins-hbase4:42509] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:00:59,209 INFO [RS:1;jenkins-hbase4:42509] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:00:59,210 INFO [RS:1;jenkins-hbase4:42509] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42509 2023-02-16 09:00:59,210 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 09:00:59,210 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 09:00:59,211 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:59,211 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:59,211 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42509,1676538055954 2023-02-16 09:00:59,211 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52586b80 rejected from java.util.concurrent.ThreadPoolExecutor@5667e513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,211 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:59,212 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:59,212 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33a91922 rejected from java.util.concurrent.ThreadPoolExecutor@5667e513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,212 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42509,1676538055954] 2023-02-16 09:00:59,212 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42509,1676538055954; numProcessing=1 2023-02-16 09:00:59,213 DEBUG [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/oldWALs 2023-02-16 09:00:59,213 INFO [RS:0;jenkins-hbase4:38983] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38983%2C1676538055934:(num 1676538057235) 2023-02-16 09:00:59,213 DEBUG [RS:0;jenkins-hbase4:38983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:59,213 INFO [RS:0;jenkins-hbase4:38983] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:00:59,213 INFO [RS:0;jenkins-hbase4:38983] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:00:59,213 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:59,214 INFO [RS:0;jenkins-hbase4:38983] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38983 2023-02-16 09:00:59,215 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42509,1676538055954 already deleted, retry=false 2023-02-16 09:00:59,215 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42509,1676538055954 expired; onlineServers=1 2023-02-16 09:00:59,215 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38983,1676538055934 2023-02-16 09:00:59,215 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a842eca rejected from java.util.concurrent.ThreadPoolExecutor@7ebbb542[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,215 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:00:59,216 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38983,1676538055934] 2023-02-16 09:00:59,216 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38983,1676538055934; numProcessing=2 2023-02-16 09:00:59,217 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38983,1676538055934 already deleted, retry=false 2023-02-16 09:00:59,217 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38983,1676538055934 expired; onlineServers=0 2023-02-16 09:00:59,217 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34797,1676538055859' ***** 2023-02-16 09:00:59,218 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:00:59,218 DEBUG [M:0;jenkins-hbase4:34797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358bfa25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:00:59,218 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34797,1676538055859 2023-02-16 09:00:59,218 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34797,1676538055859; all regions closed. 2023-02-16 09:00:59,218 DEBUG [M:0;jenkins-hbase4:34797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:00:59,219 DEBUG [M:0;jenkins-hbase4:34797] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:00:59,219 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:00:59,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538056073] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538056073,5,FailOnTimeoutGroup] 2023-02-16 09:00:59,219 DEBUG [M:0;jenkins-hbase4:34797] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:00:59,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538056073] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538056073,5,FailOnTimeoutGroup] 2023-02-16 09:00:59,219 INFO [M:0;jenkins-hbase4:34797] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:00:59,220 INFO [M:0;jenkins-hbase4:34797] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:00:59,220 INFO [M:0;jenkins-hbase4:34797] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:00:59,220 DEBUG [M:0;jenkins-hbase4:34797] master.HMaster(1512): Stopping service threads 2023-02-16 09:00:59,220 INFO [M:0;jenkins-hbase4:34797] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:00:59,221 ERROR [M:0;jenkins-hbase4:34797] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:00:59,221 INFO [M:0;jenkins-hbase4:34797] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:00:59,221 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:00:59,222 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:00:59,222 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:00:59,222 DEBUG [M:0;jenkins-hbase4:34797] zookeeper.ZKUtil(398): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:00:59,222 WARN [M:0;jenkins-hbase4:34797] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:00:59,222 INFO [M:0;jenkins-hbase4:34797] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:00:59,222 INFO [M:0;jenkins-hbase4:34797] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:00:59,223 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:00:59,223 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:59,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:00:59,223 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:59,223 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:00:59,223 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:59,223 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.59 KB 2023-02-16 09:00:59,242 INFO [M:0;jenkins-hbase4:34797] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4386c4173f7e445d9511812e4bf78ac9 2023-02-16 09:00:59,247 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4386c4173f7e445d9511812e4bf78ac9 as hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4386c4173f7e445d9511812e4bf78ac9 2023-02-16 09:00:59,251 INFO [M:0;jenkins-hbase4:34797] regionserver.HStore(1080): Added hdfs://localhost:38953/user/jenkins/test-data/dd0c7435-010d-8e3c-f526-4b91b5f3f659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4386c4173f7e445d9511812e4bf78ac9, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 09:00:59,252 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/57997, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=132, compaction requested=false 2023-02-16 09:00:59,252 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:00:59,252 DEBUG [M:0;jenkins-hbase4:34797] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:00:59,254 INFO [M:0;jenkins-hbase4:34797] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:00:59,254 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:00:59,255 INFO [M:0;jenkins-hbase4:34797] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34797 2023-02-16 09:00:59,257 DEBUG [M:0;jenkins-hbase4:34797] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34797,1676538055859 already deleted, retry=false 2023-02-16 09:00:59,496 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,496 INFO [M:0;jenkins-hbase4:34797] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34797,1676538055859; zookeeper connection closed. 2023-02-16 09:00:59,496 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b26c830 rejected from java.util.concurrent.ThreadPoolExecutor@1f195f8c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,497 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): master:34797-0x1005c5c76630000, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,497 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46414b60 rejected from java.util.concurrent.ThreadPoolExecutor@1f195f8c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,596 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,596 INFO [RS:0;jenkins-hbase4:38983] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38983,1676538055934; zookeeper connection closed. 2023-02-16 09:00:59,596 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5161cffa rejected from java.util.concurrent.ThreadPoolExecutor@7ebbb542[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,597 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:38983-0x1005c5c76630001, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,597 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@297aeccc rejected from java.util.concurrent.ThreadPoolExecutor@7ebbb542[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,597 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44b5c6a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44b5c6a6 2023-02-16 09:00:59,696 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,696 INFO [RS:1;jenkins-hbase4:42509] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42509,1676538055954; zookeeper connection closed. 2023-02-16 09:00:59,697 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b1a5695 rejected from java.util.concurrent.ThreadPoolExecutor@5667e513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,697 DEBUG [Listener at localhost/44341-EventThread] zookeeper.ZKWatcher(600): regionserver:42509-0x1005c5c76630002, quorum=127.0.0.1:51767, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:00:59,697 ERROR [Listener at localhost/44341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@851e9b6 rejected from java.util.concurrent.ThreadPoolExecutor@5667e513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:00:59,697 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37fbbcd6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37fbbcd6 2023-02-16 09:00:59,697 INFO [Listener at localhost/44341] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:00:59,697 WARN [Listener at localhost/44341] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:59,701 INFO [Listener at localhost/44341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:59,804 WARN [BP-1157824872-172.31.14.131-1676538055238 heartbeating to localhost/127.0.0.1:38953] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:59,804 WARN [BP-1157824872-172.31.14.131-1676538055238 heartbeating to localhost/127.0.0.1:38953] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1157824872-172.31.14.131-1676538055238 (Datanode Uuid 569ea7bf-7050-4088-b9f7-3efd733d046e) service to localhost/127.0.0.1:38953 2023-02-16 09:00:59,805 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/dfs/data/data3/current/BP-1157824872-172.31.14.131-1676538055238] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:59,805 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/dfs/data/data4/current/BP-1157824872-172.31.14.131-1676538055238] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:59,806 WARN [Listener at localhost/44341] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:00:59,810 INFO [Listener at localhost/44341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:00:59,914 WARN [BP-1157824872-172.31.14.131-1676538055238 heartbeating to localhost/127.0.0.1:38953] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:00:59,914 WARN [BP-1157824872-172.31.14.131-1676538055238 heartbeating to localhost/127.0.0.1:38953] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1157824872-172.31.14.131-1676538055238 (Datanode Uuid acc28a69-0cea-4943-af5d-eda0cc0bd791) service to localhost/127.0.0.1:38953 2023-02-16 09:00:59,915 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/dfs/data/data1/current/BP-1157824872-172.31.14.131-1676538055238] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:59,915 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/cluster_df828e8a-60e0-b126-9353-de032def354f/dfs/data/data2/current/BP-1157824872-172.31.14.131-1676538055238] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:00:59,925 INFO [Listener at localhost/44341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:01:00,038 INFO [Listener at localhost/44341] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:01:00,058 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:01:00,070 INFO [Listener at localhost/44341] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 255) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38953 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,34797,1676538055859)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44341 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:38953 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38953 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38953 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38953 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38953 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:38953 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 263) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1415 (was 1456) 2023-02-16 09:01:00,081 INFO [Listener at localhost/44341] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=170, AvailableMemoryMB=1414 2023-02-16 09:01:00,091 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.log.dir so I do NOT create it in target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f 2023-02-16 09:01:00,091 WARN [Listener at localhost/44341] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 09:01:00,091 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.tmp.dir so I do NOT create it in target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f 2023-02-16 09:01:00,091 WARN [Listener at localhost/44341] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/328a7023-d353-d07f-03a4-04fefef9c1a7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 09:01:00,091 DEBUG [Listener at localhost/44341] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f 2023-02-16 09:01:00,091 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 09:01:00,091 INFO [Listener at localhost/44341] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d, deleteOnExit=true 2023-02-16 09:01:00,091 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/test.cache.data in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop.log.dir in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 09:01:00,092 DEBUG [Listener at localhost/44341] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:01:00,092 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/nfs.dump.dir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/java.io.tmpdir in system properties and HBase conf 2023-02-16 09:01:00,093 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 09:01:00,094 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 09:01:00,094 INFO [Listener at localhost/44341] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 09:01:00,097 WARN [Listener at localhost/44341] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:01:00,098 WARN [Listener at localhost/44341] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:01:00,138 WARN [Listener at localhost/44341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:01:00,140 INFO [Listener at localhost/44341] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:01:00,147 INFO [Listener at localhost/44341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/java.io.tmpdir/Jetty_localhost_36975_hdfs____.mayi82/webapp 2023-02-16 09:01:00,246 INFO [Listener at localhost/44341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36975 2023-02-16 09:01:00,250 WARN [Listener at localhost/44341] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 09:01:00,251 WARN [Listener at localhost/44341] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 09:01:00,339 WARN [Listener at localhost/38759] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:01:00,351 WARN [Listener at localhost/38759] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:01:00,354 WARN [Listener at localhost/38759] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:01:00,355 INFO [Listener at localhost/38759] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:01:00,363 INFO [Listener at localhost/38759] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/java.io.tmpdir/Jetty_localhost_37837_datanode____115jfj/webapp 2023-02-16 09:01:00,457 INFO [Listener at localhost/38759] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37837 2023-02-16 09:01:00,464 WARN [Listener at localhost/46193] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:01:00,478 WARN [Listener at localhost/46193] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 09:01:00,480 WARN [Listener at localhost/46193] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 09:01:00,481 INFO [Listener at localhost/46193] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 09:01:00,486 INFO [Listener at localhost/46193] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/java.io.tmpdir/Jetty_localhost_46237_datanode____obpvzv/webapp 2023-02-16 09:01:00,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf17526dc7456aaba: Processing first storage report for DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9 from datanode 6e073fac-8cda-4d9d-8917-bc964233d194 2023-02-16 09:01:00,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf17526dc7456aaba: from storage DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9 node DatanodeRegistration(127.0.0.1:46307, datanodeUuid=6e073fac-8cda-4d9d-8917-bc964233d194, infoPort=41559, infoSecurePort=0, ipcPort=46193, storageInfo=lv=-57;cid=testClusterID;nsid=1355628886;c=1676538060100), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:01:00,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf17526dc7456aaba: Processing first storage report for DS-d066c8f1-c087-4722-9a03-ccaba43fce5c from datanode 6e073fac-8cda-4d9d-8917-bc964233d194 2023-02-16 09:01:00,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf17526dc7456aaba: from storage DS-d066c8f1-c087-4722-9a03-ccaba43fce5c node DatanodeRegistration(127.0.0.1:46307, datanodeUuid=6e073fac-8cda-4d9d-8917-bc964233d194, infoPort=41559, infoSecurePort=0, ipcPort=46193, storageInfo=lv=-57;cid=testClusterID;nsid=1355628886;c=1676538060100), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:01:00,597 INFO [Listener at localhost/46193] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46237 2023-02-16 09:01:00,605 WARN [Listener at localhost/39023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 09:01:00,717 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbeadb3455ac7dd97: Processing first storage report for DS-dfe89ea7-8763-4000-9816-4ea432299eaa from datanode dc39ae52-0ff9-40ca-910a-74ed6a32d82a 2023-02-16 09:01:00,718 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbeadb3455ac7dd97: from storage DS-dfe89ea7-8763-4000-9816-4ea432299eaa node DatanodeRegistration(127.0.0.1:43241, datanodeUuid=dc39ae52-0ff9-40ca-910a-74ed6a32d82a, infoPort=36717, infoSecurePort=0, ipcPort=39023, storageInfo=lv=-57;cid=testClusterID;nsid=1355628886;c=1676538060100), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 09:01:00,718 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbeadb3455ac7dd97: Processing first storage report for DS-4ce62c32-103c-4736-8d91-d8485dd8fa0c from datanode dc39ae52-0ff9-40ca-910a-74ed6a32d82a 2023-02-16 09:01:00,718 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbeadb3455ac7dd97: from storage DS-4ce62c32-103c-4736-8d91-d8485dd8fa0c node DatanodeRegistration(127.0.0.1:43241, datanodeUuid=dc39ae52-0ff9-40ca-910a-74ed6a32d82a, infoPort=36717, infoSecurePort=0, ipcPort=39023, storageInfo=lv=-57;cid=testClusterID;nsid=1355628886;c=1676538060100), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 09:01:00,818 DEBUG [Listener at localhost/39023] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f 2023-02-16 09:01:00,820 INFO [Listener at localhost/39023] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/zookeeper_0, clientPort=60420, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 09:01:00,821 INFO [Listener at localhost/39023] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60420 2023-02-16 09:01:00,821 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,822 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,834 INFO [Listener at localhost/39023] util.FSUtils(479): Created version file at hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72 with version=8 2023-02-16 09:01:00,834 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,835 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,836 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/hbase-staging 2023-02-16 09:01:00,837 INFO [Listener at localhost/39023] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:01:00,838 INFO [Listener at localhost/39023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:01:00,839 INFO [Listener at localhost/39023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38675 2023-02-16 09:01:00,839 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,839 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,840 INFO [Listener at localhost/39023] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38675 connecting to ZooKeeper ensemble=127.0.0.1:60420 2023-02-16 09:01:00,848 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:386750x0, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:01:00,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38675-0x1005c5c89d80000 connected 2023-02-16 09:01:00,864 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:01:00,864 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:00,864 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:01:00,865 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38675 2023-02-16 09:01:00,865 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38675 2023-02-16 09:01:00,866 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38675 2023-02-16 09:01:00,866 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38675 2023-02-16 09:01:00,866 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38675 2023-02-16 09:01:00,866 INFO [Listener at localhost/39023] master.HMaster(444): hbase.rootdir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72, hbase.cluster.distributed=false 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:01:00,878 INFO [Listener at localhost/39023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:01:00,879 INFO [Listener at localhost/39023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44913 2023-02-16 09:01:00,879 INFO [Listener at localhost/39023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:01:00,880 DEBUG [Listener at localhost/39023] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:01:00,880 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,881 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,882 INFO [Listener at localhost/39023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44913 connecting to ZooKeeper ensemble=127.0.0.1:60420 2023-02-16 09:01:00,883 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:449130x0, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:01:00,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44913-0x1005c5c89d80001 connected 2023-02-16 09:01:00,886 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:01:00,886 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:00,887 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:01:00,887 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44913 2023-02-16 09:01:00,887 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44913 2023-02-16 09:01:00,888 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44913 2023-02-16 09:01:00,888 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44913 2023-02-16 09:01:00,888 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44913 2023-02-16 09:01:00,898 INFO [Listener at localhost/39023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 09:01:00,898 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,898 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33883 2023-02-16 09:01:00,899 INFO [Listener at localhost/39023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 09:01:00,900 DEBUG [Listener at localhost/39023] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:01:00,900 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,901 INFO [Listener at localhost/39023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,902 INFO [Listener at localhost/39023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33883 connecting to ZooKeeper ensemble=127.0.0.1:60420 2023-02-16 09:01:00,903 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:338830x0, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 09:01:00,904 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:338830x0, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:01:00,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33883-0x1005c5c89d80002 connected 2023-02-16 09:01:00,905 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:00,905 DEBUG [Listener at localhost/39023] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 09:01:00,905 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33883 2023-02-16 09:01:00,906 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33883 2023-02-16 09:01:00,906 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33883 2023-02-16 09:01:00,906 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33883 2023-02-16 09:01:00,906 DEBUG [Listener at localhost/39023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33883 2023-02-16 09:01:00,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:00,909 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:01:00,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:00,911 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:01:00,911 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:01:00,911 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:00,911 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 09:01:00,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:01:00,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 09:01:00,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38675,1676538060837 from backup master directory 2023-02-16 09:01:00,916 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:00,916 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 09:01:00,916 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:01:00,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:00,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/hbase.id with ID: f2e7cece-cf61-4f37-89bb-7172528f8585 2023-02-16 09:01:00,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 09:01:00,934 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:00,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0e6dd230 to 127.0.0.1:60420 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:01:00,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1106019a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:01:00,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:01:00,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 09:01:00,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:01:00,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store-tmp 2023-02-16 09:01:00,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:00,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:01:00,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:00,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:00,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:01:00,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:00,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:00,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:01:00,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/WALs/jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:00,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38675%2C1676538060837, suffix=, logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/WALs/jenkins-hbase4.apache.org,38675,1676538060837, archiveDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/oldWALs, maxLogs=10 2023-02-16 09:01:00,966 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK] 2023-02-16 09:01:00,966 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK] 2023-02-16 09:01:00,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/WALs/jenkins-hbase4.apache.org,38675,1676538060837/jenkins-hbase4.apache.org%2C38675%2C1676538060837.1676538060955 2023-02-16 09:01:00,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK], DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK]] 2023-02-16 09:01:00,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:01:00,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:00,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,970 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,970 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 09:01:00,971 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 09:01:00,971 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:00,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 09:01:00,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:01:00,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59368945, jitterRate=-0.11533378064632416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:01:00,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:01:00,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 09:01:00,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 09:01:00,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 09:01:00,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 09:01:00,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 09:01:00,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 09:01:00,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 09:01:00,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 09:01:00,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 09:01:00,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 09:01:00,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 09:01:00,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 09:01:00,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 09:01:00,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 09:01:00,992 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:00,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 09:01:00,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 09:01:00,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 09:01:00,995 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:00,995 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:00,995 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:00,995 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:00,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38675,1676538060837, sessionid=0x1005c5c89d80000, setting cluster-up flag (Was=false) 2023-02-16 09:01:00,999 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:01,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 09:01:01,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:01,007 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:01,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 09:01:01,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:01,011 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/.tmp 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:01:01,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676538091014 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 09:01:01,014 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 09:01:01,014 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 09:01:01,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 09:01:01,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 09:01:01,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 09:01:01,015 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:01:01,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 09:01:01,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 09:01:01,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538061016,5,FailOnTimeoutGroup] 2023-02-16 09:01:01,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538061016,5,FailOnTimeoutGroup] 2023-02-16 09:01:01,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 09:01:01,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,022 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:01:01,022 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 09:01:01,022 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72 2023-02-16 09:01:01,027 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:01,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:01:01,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/info 2023-02-16 09:01:01,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:01:01,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:01:01,030 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:01:01,030 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:01:01,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:01:01,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/table 2023-02-16 09:01:01,031 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:01:01,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,032 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740 2023-02-16 09:01:01,033 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740 2023-02-16 09:01:01,034 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:01:01,035 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:01:01,036 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:01:01,036 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69145677, jitterRate=0.030350878834724426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:01:01,036 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:01:01,036 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:01:01,036 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:01:01,036 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:01:01,037 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:01:01,037 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:01:01,037 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:01:01,037 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:01:01,037 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 09:01:01,037 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 09:01:01,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 09:01:01,039 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 09:01:01,040 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 09:01:01,109 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(952): ClusterId : f2e7cece-cf61-4f37-89bb-7172528f8585 2023-02-16 09:01:01,109 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(952): ClusterId : f2e7cece-cf61-4f37-89bb-7172528f8585 2023-02-16 09:01:01,109 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:01:01,109 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 09:01:01,112 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:01:01,112 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:01:01,112 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 09:01:01,113 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 09:01:01,115 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:01:01,117 DEBUG [RS:1;jenkins-hbase4:33883] zookeeper.ReadOnlyZKClient(139): Connect 0x16e3b44b to 127.0.0.1:60420 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:01:01,117 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 09:01:01,118 DEBUG [RS:0;jenkins-hbase4:44913] zookeeper.ReadOnlyZKClient(139): Connect 0x071cf988 to 127.0.0.1:60420 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:01:01,129 DEBUG [RS:1;jenkins-hbase4:33883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@182448e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:01:01,129 DEBUG [RS:0;jenkins-hbase4:44913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9db171b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:01:01,129 DEBUG [RS:1;jenkins-hbase4:33883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c1bdf3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:01:01,130 DEBUG [RS:0;jenkins-hbase4:44913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@de492f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:01:01,139 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44913 2023-02-16 09:01:01,139 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33883 2023-02-16 09:01:01,139 INFO [RS:0;jenkins-hbase4:44913] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:01:01,139 INFO [RS:0;jenkins-hbase4:44913] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:01:01,140 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:01:01,139 INFO [RS:1;jenkins-hbase4:33883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 09:01:01,140 INFO [RS:1;jenkins-hbase4:33883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 09:01:01,140 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 09:01:01,140 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38675,1676538060837 with isa=jenkins-hbase4.apache.org/172.31.14.131:33883, startcode=1676538060898 2023-02-16 09:01:01,140 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38675,1676538060837 with isa=jenkins-hbase4.apache.org/172.31.14.131:44913, startcode=1676538060878 2023-02-16 09:01:01,140 DEBUG [RS:1;jenkins-hbase4:33883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:01:01,140 DEBUG [RS:0;jenkins-hbase4:44913] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 09:01:01,142 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45963, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:01:01,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,145 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38427, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 09:01:01,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,145 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72 2023-02-16 09:01:01,145 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38759 2023-02-16 09:01:01,145 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:01:01,145 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72 2023-02-16 09:01:01,146 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38759 2023-02-16 09:01:01,146 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 09:01:01,146 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:01:01,150 DEBUG [RS:0;jenkins-hbase4:44913] zookeeper.ZKUtil(162): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,150 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44913,1676538060878] 2023-02-16 09:01:01,150 WARN [RS:0;jenkins-hbase4:44913] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:01:01,150 DEBUG [RS:1;jenkins-hbase4:33883] zookeeper.ZKUtil(162): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,150 INFO [RS:0;jenkins-hbase4:44913] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:01:01,150 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33883,1676538060898] 2023-02-16 09:01:01,150 WARN [RS:1;jenkins-hbase4:33883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 09:01:01,150 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,150 INFO [RS:1;jenkins-hbase4:33883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:01:01,150 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,159 DEBUG [RS:1;jenkins-hbase4:33883] zookeeper.ZKUtil(162): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,159 DEBUG [RS:0;jenkins-hbase4:44913] zookeeper.ZKUtil(162): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,159 DEBUG [RS:1;jenkins-hbase4:33883] zookeeper.ZKUtil(162): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,159 DEBUG [RS:0;jenkins-hbase4:44913] zookeeper.ZKUtil(162): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,160 DEBUG [RS:1;jenkins-hbase4:33883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:01:01,160 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 09:01:01,161 INFO [RS:1;jenkins-hbase4:33883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:01:01,161 INFO [RS:0;jenkins-hbase4:44913] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 09:01:01,162 INFO [RS:1;jenkins-hbase4:33883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:01:01,164 INFO [RS:1;jenkins-hbase4:33883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:01:01,164 INFO [RS:0;jenkins-hbase4:44913] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 09:01:01,164 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,164 INFO [RS:0;jenkins-hbase4:44913] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 09:01:01,164 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,167 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:01:01,170 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 09:01:01,171 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,172 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,172 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:0;jenkins-hbase4:44913] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,174 DEBUG [RS:1;jenkins-hbase4:33883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 09:01:01,175 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,176 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,176 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,176 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,176 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,176 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,187 INFO [RS:0;jenkins-hbase4:44913] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:01:01,187 INFO [RS:1;jenkins-hbase4:33883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 09:01:01,188 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44913,1676538060878-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,188 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33883,1676538060898-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,190 DEBUG [jenkins-hbase4:38675] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 09:01:01,191 DEBUG [jenkins-hbase4:38675] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:01:01,192 DEBUG [jenkins-hbase4:38675] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:01:01,192 DEBUG [jenkins-hbase4:38675] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:01:01,192 DEBUG [jenkins-hbase4:38675] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:01:01,192 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44913,1676538060878, state=OPENING 2023-02-16 09:01:01,193 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 09:01:01,194 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:01,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44913,1676538060878}] 2023-02-16 09:01:01,194 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:01:01,200 INFO [RS:0;jenkins-hbase4:44913] regionserver.Replication(203): jenkins-hbase4.apache.org,44913,1676538060878 started 2023-02-16 09:01:01,200 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44913,1676538060878, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44913, sessionid=0x1005c5c89d80001 2023-02-16 09:01:01,200 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:01:01,200 DEBUG [RS:0;jenkins-hbase4:44913] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,200 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44913,1676538060878' 2023-02-16 09:01:01,200 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:01,200 INFO [RS:1;jenkins-hbase4:33883] regionserver.Replication(203): jenkins-hbase4.apache.org,33883,1676538060898 started 2023-02-16 09:01:01,200 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:01,200 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33883,1676538060898, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33883, sessionid=0x1005c5c89d80002 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33883,1676538060898' 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44913,1676538060878' 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33883,1676538060898' 2023-02-16 09:01:01,201 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:01,201 DEBUG [RS:0;jenkins-hbase4:44913] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:01:01,201 INFO [RS:0;jenkins-hbase4:44913] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:01:01,201 INFO [RS:0;jenkins-hbase4:44913] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:01:01,202 DEBUG [RS:1;jenkins-hbase4:33883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:01,202 DEBUG [RS:1;jenkins-hbase4:33883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 09:01:01,202 INFO [RS:1;jenkins-hbase4:33883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 09:01:01,202 INFO [RS:1;jenkins-hbase4:33883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 09:01:01,348 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,349 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:01:01,350 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:01:01,355 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 09:01:01,355 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 09:01:01,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44913%2C1676538060878.meta, suffix=.meta, logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,44913,1676538060878, archiveDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs, maxLogs=32 2023-02-16 09:01:01,371 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK] 2023-02-16 09:01:01,371 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK] 2023-02-16 09:01:01,373 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,44913,1676538060878/jenkins-hbase4.apache.org%2C44913%2C1676538060878.meta.1676538061356.meta 2023-02-16 09:01:01,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK], DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK]] 2023-02-16 09:01:01,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:01:01,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 09:01:01,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 09:01:01,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 09:01:01,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 09:01:01,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:01,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 09:01:01,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 09:01:01,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 09:01:01,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/info 2023-02-16 09:01:01,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/info 2023-02-16 09:01:01,376 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 09:01:01,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 09:01:01,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:01:01,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/rep_barrier 2023-02-16 09:01:01,378 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 09:01:01,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 09:01:01,379 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/table 2023-02-16 09:01:01,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/table 2023-02-16 09:01:01,380 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 09:01:01,380 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740 2023-02-16 09:01:01,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740 2023-02-16 09:01:01,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 09:01:01,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 09:01:01,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65963166, jitterRate=-0.017072230577468872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 09:01:01,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 09:01:01,386 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676538061348 2023-02-16 09:01:01,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 09:01:01,391 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 09:01:01,392 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44913,1676538060878, state=OPEN 2023-02-16 09:01:01,393 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 09:01:01,393 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 09:01:01,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 09:01:01,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44913,1676538060878 in 199 msec 2023-02-16 09:01:01,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 09:01:01,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-16 09:01:01,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 385 msec 2023-02-16 09:01:01,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676538061397, completionTime=-1 2023-02-16 09:01:01,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 09:01:01,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 09:01:01,400 DEBUG [hconnection-0x14fed3ad-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:01:01,402 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45522, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:01:01,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 09:01:01,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676538121403 2023-02-16 09:01:01,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676538181403 2023-02-16 09:01:01,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38675,1676538060837-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38675,1676538060837-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38675,1676538060837-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38675, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 09:01:01,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 09:01:01,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 09:01:01,413 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:01:01,414 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 09:01:01,414 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:01:01,415 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/hbase/namespace/f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,415 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/hbase/namespace/f523b398762121a5d783d15a3d785675 empty. 2023-02-16 09:01:01,416 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/hbase/namespace/f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,416 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 09:01:01,425 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 09:01:01,426 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f523b398762121a5d783d15a3d785675, NAME => 'hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp 2023-02-16 09:01:01,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:01,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f523b398762121a5d783d15a3d785675, disabling compactions & flushes 2023-02-16 09:01:01,433 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. after waiting 0 ms 2023-02-16 09:01:01,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,433 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f523b398762121a5d783d15a3d785675: 2023-02-16 09:01:01,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:01:01,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538061435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538061435"}]},"ts":"1676538061435"} 2023-02-16 09:01:01,437 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:01:01,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:01:01,437 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538061437"}]},"ts":"1676538061437"} 2023-02-16 09:01:01,439 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 09:01:01,441 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:01:01,441 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:01:01,441 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:01:01,441 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:01:01,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f523b398762121a5d783d15a3d785675, ASSIGN}] 2023-02-16 09:01:01,444 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f523b398762121a5d783d15a3d785675, ASSIGN 2023-02-16 09:01:01,444 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f523b398762121a5d783d15a3d785675, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44913,1676538060878; forceNewPlan=false, retain=false 2023-02-16 09:01:01,595 INFO [jenkins-hbase4:38675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:01:01,595 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f523b398762121a5d783d15a3d785675, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,595 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538061595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538061595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538061595"}]},"ts":"1676538061595"} 2023-02-16 09:01:01,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f523b398762121a5d783d15a3d785675, server=jenkins-hbase4.apache.org,44913,1676538060878}] 2023-02-16 09:01:01,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,752 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44913%2C1676538060878, suffix=, logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,44913,1676538060878, archiveDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs, maxLogs=32 2023-02-16 09:01:01,765 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK] 2023-02-16 09:01:01,765 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK] 2023-02-16 09:01:01,767 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,44913,1676538060878/jenkins-hbase4.apache.org%2C44913%2C1676538060878.1676538061752 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK], DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK]] 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f523b398762121a5d783d15a3d785675, NAME => 'hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,768 INFO [StoreOpener-f523b398762121a5d783d15a3d785675-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,769 DEBUG [StoreOpener-f523b398762121a5d783d15a3d785675-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/info 2023-02-16 09:01:01,769 DEBUG [StoreOpener-f523b398762121a5d783d15a3d785675-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/info 2023-02-16 09:01:01,770 INFO [StoreOpener-f523b398762121a5d783d15a3d785675-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f523b398762121a5d783d15a3d785675 columnFamilyName info 2023-02-16 09:01:01,770 INFO [StoreOpener-f523b398762121a5d783d15a3d785675-1] regionserver.HStore(310): Store=f523b398762121a5d783d15a3d785675/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:01,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f523b398762121a5d783d15a3d785675 2023-02-16 09:01:01,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:01:01,774 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f523b398762121a5d783d15a3d785675; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71852336, jitterRate=0.07068324089050293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 09:01:01,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f523b398762121a5d783d15a3d785675: 2023-02-16 09:01:01,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675., pid=6, masterSystemTime=1676538061748 2023-02-16 09:01:01,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:01,778 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f523b398762121a5d783d15a3d785675, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:01,778 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676538061777"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538061777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538061777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538061777"}]},"ts":"1676538061777"} 2023-02-16 09:01:01,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 09:01:01,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f523b398762121a5d783d15a3d785675, server=jenkins-hbase4.apache.org,44913,1676538060878 in 182 msec 2023-02-16 09:01:01,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 09:01:01,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f523b398762121a5d783d15a3d785675, ASSIGN in 338 msec 2023-02-16 09:01:01,782 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:01:01,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538061782"}]},"ts":"1676538061782"} 2023-02-16 09:01:01,783 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 09:01:01,785 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:01:01,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 375 msec 2023-02-16 09:01:01,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 09:01:01,814 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:01:01,814 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:01,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 09:01:01,824 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:01:01,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 09:01:01,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 09:01:01,835 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 09:01:01,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 09:01:01,844 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 09:01:01,845 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 09:01:01,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.929sec 2023-02-16 09:01:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 09:01:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 09:01:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 09:01:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38675,1676538060837-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 09:01:01,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38675,1676538060837-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 09:01:01,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 09:01:01,909 DEBUG [Listener at localhost/39023] zookeeper.ReadOnlyZKClient(139): Connect 0x13bc40cc to 127.0.0.1:60420 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:01:01,912 DEBUG [Listener at localhost/39023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@376492b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:01:01,914 DEBUG [hconnection-0x188651f1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:01:01,915 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45532, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:01:01,917 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:01,917 DEBUG [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 09:01:01,919 DEBUG [Listener at localhost/39023] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 09:01:01,921 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59684, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 09:01:01,921 INFO [Listener at localhost/39023] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 09:01:01,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 09:01:01,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 09:01:01,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:59684 deadline: 1676538121921, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 09:01:01,922 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 09:01:01,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 09:01:01,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 09:01:01,929 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 09:01:01,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 09:01:01,929 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 09:01:01,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:01:01,931 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:01,931 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 empty. 2023-02-16 09:01:01,932 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:01,932 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 09:01:01,937 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:01:01,950 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 09:01:01,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0b91c545861488c85762f2341ad54518, NAME => 'testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0b91c545861488c85762f2341ad54518, disabling compactions & flushes 2023-02-16 09:01:01,960 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. after waiting 0 ms 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:01,960 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:01,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 09:01:01,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676538061964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538061964"}]},"ts":"1676538061964"} 2023-02-16 09:01:01,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 09:01:01,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 09:01:01,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538061967"}]},"ts":"1676538061967"} 2023-02-16 09:01:01,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 09:01:01,972 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 09:01:01,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 09:01:01,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 09:01:01,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 09:01:01,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, ASSIGN}] 2023-02-16 09:01:01,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, ASSIGN 2023-02-16 09:01:01,977 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33883,1676538060898; forceNewPlan=false, retain=false 2023-02-16 09:01:02,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:01:02,128 INFO [jenkins-hbase4:38675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 09:01:02,128 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0b91c545861488c85762f2341ad54518, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,128 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676538062128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538062128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538062128"}]},"ts":"1676538062128"} 2023-02-16 09:01:02,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0b91c545861488c85762f2341ad54518, server=jenkins-hbase4.apache.org,33883,1676538060898}] 2023-02-16 09:01:02,203 INFO [RS:1;jenkins-hbase4:33883] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33883%2C1676538060898, suffix=, logDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,33883,1676538060898, archiveDir=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs, maxLogs=32 2023-02-16 09:01:02,218 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK] 2023-02-16 09:01:02,218 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK] 2023-02-16 09:01:02,220 INFO [RS:1;jenkins-hbase4:33883] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/WALs/jenkins-hbase4.apache.org,33883,1676538060898/jenkins-hbase4.apache.org%2C33883%2C1676538060898.1676538062204 2023-02-16 09:01:02,221 DEBUG [RS:1;jenkins-hbase4:33883] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46307,DS-e20ca3ef-59ca-408f-8955-c8d75d55f7c9,DISK], DatanodeInfoWithStorage[127.0.0.1:43241,DS-dfe89ea7-8763-4000-9816-4ea432299eaa,DISK]] 2023-02-16 09:01:02,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:01:02,282 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,282 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 09:01:02,284 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 09:01:02,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0b91c545861488c85762f2341ad54518, NAME => 'testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.', STARTKEY => '', ENDKEY => ''} 2023-02-16 09:01:02,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:02,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,288 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,289 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1 2023-02-16 09:01:02,289 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1 2023-02-16 09:01:02,290 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b91c545861488c85762f2341ad54518 columnFamilyName f1 2023-02-16 09:01:02,290 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(310): Store=0b91c545861488c85762f2341ad54518/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:02,290 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,291 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2 2023-02-16 09:01:02,291 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2 2023-02-16 09:01:02,291 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b91c545861488c85762f2341ad54518 columnFamilyName f2 2023-02-16 09:01:02,292 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(310): Store=0b91c545861488c85762f2341ad54518/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:02,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:01:02,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:02,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 09:01:02,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0b91c545861488c85762f2341ad54518; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63252942, jitterRate=-0.05745771527290344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:01:02,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:02,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518., pid=12, masterSystemTime=1676538062282 2023-02-16 09:01:02,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,301 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0b91c545861488c85762f2341ad54518, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,301 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676538062301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676538062301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676538062301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676538062301"}]},"ts":"1676538062301"} 2023-02-16 09:01:02,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 09:01:02,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0b91c545861488c85762f2341ad54518, server=jenkins-hbase4.apache.org,33883,1676538060898 in 173 msec 2023-02-16 09:01:02,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 09:01:02,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, ASSIGN in 331 msec 2023-02-16 09:01:02,306 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 09:01:02,306 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538062306"}]},"ts":"1676538062306"} 2023-02-16 09:01:02,307 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 09:01:02,309 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 09:01:02,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 385 msec 2023-02-16 09:01:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 09:01:02,534 INFO [Listener at localhost/39023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 09:01:02,534 DEBUG [Listener at localhost/39023] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 09:01:02,534 INFO [Listener at localhost/39023] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:01:02,536 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 09:01:02,537 INFO [Listener at localhost/39023] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 09:01:02,537 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 09:01:02,537 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 09:01:02,554 DEBUG [hconnection-0x188651f1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:01:02,568 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:01:02,576 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33883] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,672 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 09:01:02,672 INFO [Listener at localhost/39023] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 09:01:02,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:01:02,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676538062673 (current time:1676538062673). 2023-02-16 09:01:02,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 09:01:02,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] zookeeper.ReadOnlyZKClient(139): Connect 0x262e417e to 127.0.0.1:60420 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 09:01:02,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab475ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 09:01:02,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 09:01:02,678 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45544, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 09:01:02,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x262e417e to 127.0.0.1:60420 2023-02-16 09:01:02,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:02,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 09:01:02,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:01:02,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:01:02,682 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:01:02,683 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676538662683 2023-02-16 09:01:02,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 09:01:02,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 09:01:02,685 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 09:01:02,685 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 09:01:02,685 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 09:01:02,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:01:02,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-16 09:01:02,687 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:01:02,687 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676538662687 2023-02-16 09:01:02,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-16 09:01:02,693 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-16 09:01:02,693 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:01:02,694 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-16 09:01:02,694 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 09:01:02,695 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,695 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,696 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:01:02,696 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:01:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:02,696 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:01:02,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:01:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:02,696 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,696 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:01:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 09:01:02,697 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 09:01:02,697 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:01:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 09:01:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 09:01:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:01:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 09:01:02,700 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 09:01:02,700 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 09:01:02,700 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44913,1676538060878' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 09:01:02,700 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33883,1676538060898' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 09:01:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,703 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:01:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,704 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:01:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:01:02,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:02,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:02,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:02,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33883,1676538060898' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-16 09:01:02,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6caa2689[Count = 0] remaining members to acquire global barrier 2023-02-16 09:01:02,705 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 09:01:02,705 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,706 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:01:02,706 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 09:01:02,706 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 09:01:02,706 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,706 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:01:02,706 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44913,1676538060878' in zk 2023-02-16 09:01:02,706 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 09:01:02,707 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 09:01:02,707 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,707 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. started... 2023-02-16 09:01:02,707 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0b91c545861488c85762f2341ad54518 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 09:01:02,708 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:01:02,708 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:02,708 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 09:01:02,726 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f1/7079e1502ed7445aa60b6bad8c5d2dc3 2023-02-16 09:01:02,744 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f2/03b1a070d44e400686f8c29f64433015 2023-02-16 09:01:02,749 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f1/7079e1502ed7445aa60b6bad8c5d2dc3 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3 2023-02-16 09:01:02,753 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:01:02,754 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f2/03b1a070d44e400686f8c29f64433015 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015 2023-02-16 09:01:02,758 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 09:01:02,759 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 0b91c545861488c85762f2341ad54518 in 52ms, sequenceid=5, compaction requested=false 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3] hfiles 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3 for snapshot=testWithMapReduceSingleRegion 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015] hfiles 2023-02-16 09:01:02,759 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015 for snapshot=testWithMapReduceSingleRegion 2023-02-16 09:01:02,767 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. completed. 2023-02-16 09:01:02,768 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 09:01:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 09:01:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 09:01:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33883,1676538060898' in zk 2023-02-16 09:01:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 09:01:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:02,769 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 09:01:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:01:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33883,1676538060898': 2023-02-16 09:01:02,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33883,1676538060898' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 09:01:02,772 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-16 09:01:02,772 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:01:02,772 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:01:02,772 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-16 09:01:02,772 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 09:01:02,774 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:01:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 09:01:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,774 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,775 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:02,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:02,775 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,776 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,777 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 09:01:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 09:01:02,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-16 09:01:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:01:02,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:01:02,782 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 09:01:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:02,782 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 09:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 09:01:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:01:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:02,783 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 09:01:02,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 09:01:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 09:01:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 09:01:02,785 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:01:02,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:01:02,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 09:01:02,786 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 09:01:02,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-16 09:01:02,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-16 09:01:02,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 09:01:02,808 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 09:01:02,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676538062683Consolidate snapshot: testWithMapReduceSingleRegion at 1676538062782 (+99 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676538062783 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1676538062785 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676538062791 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676538062807 (+16 ms) 2023-02-16 09:01:02,809 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 09:01:02,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 125 msec 2023-02-16 09:01:02,986 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 09:01:02,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 09:01:02,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 09:01:02,987 INFO [Listener at localhost/39023] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 09:01:02,991 INFO [Listener at localhost/39023] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 09:01:02,995 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 09:01:03,022 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33883] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,136 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 09:01:03,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 09:01:03,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 09:01:03,142 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 09:01:03,142 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:01:03,142 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 09:01:03,142 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 09:01:03,143 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,143 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,145 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:01:03,145 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:01:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:03,145 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:01:03,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:01:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:03,145 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,145 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 09:01:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:01:03,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 09:01:03,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:01:03,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 09:01:03,147 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:01:03,147 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:01:03,147 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44913,1676538060878' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 09:01:03,148 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 09:01:03,148 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,148 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. started... 2023-02-16 09:01:03,148 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0b91c545861488c85762f2341ad54518 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 09:01:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:01:03,164 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f1/6f050d21de4b4583b5a7b7f5082ffe68 2023-02-16 09:01:03,184 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f2/90a268616bc9402ba37417ef8ee690c4 2023-02-16 09:01:03,188 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f1/6f050d21de4b4583b5a7b7f5082ffe68 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/6f050d21de4b4583b5a7b7f5082ffe68 2023-02-16 09:01:03,192 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/6f050d21de4b4583b5a7b7f5082ffe68, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:01:03,193 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/.tmp/f2/90a268616bc9402ba37417ef8ee690c4 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/90a268616bc9402ba37417ef8ee690c4 2023-02-16 09:01:03,196 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/90a268616bc9402ba37417ef8ee690c4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 09:01:03,197 INFO [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 0b91c545861488c85762f2341ad54518 in 49ms, sequenceid=9, compaction requested=false 2023-02-16 09:01:03,197 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:03,197 DEBUG [rs(jenkins-hbase4.apache.org,33883,1676538060898)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 09:01:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 09:01:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 09:01:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33883,1676538060898' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 09:01:03,198 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,198 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:01:03,199 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,199 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:03,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33883,1676538060898' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 09:01:03,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6895bfc4[Count = 0] remaining members to acquire global barrier 2023-02-16 09:01:03,200 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 09:01:03,200 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,201 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:01:03,202 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,202 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44913,1676538060878' in zk 2023-02-16 09:01:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33883,1676538060898' in zk 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 09:01:03,204 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,33883,1676538060898' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:01:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,44913,1676538060878' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 09:01:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33883,1676538060898': 2023-02-16 09:01:03,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33883,1676538060898' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 09:01:03,207 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 09:01:03,207 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 09:01:03,207 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 09:01:03,207 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 09:01:03,207 INFO [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 09:01:03,209 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:01:03,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:01:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 09:01:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 09:01:03,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:01:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:03,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:01:03,210 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 09:01:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,210 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 09:01:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,212 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,212 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 09:01:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 09:01:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 09:01:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:01:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 09:01:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:01:03,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 09:01:03,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 09:01:03,215 DEBUG [(jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 09:01:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:01:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 09:01:03,215 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 09:01:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 09:01:03,216 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 09:01:03,316 DEBUG [Listener at localhost/39023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 09:01:03,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 09:01:03,416 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop-1868639525685069786.jar 2023-02-16 09:01:03,420 INFO [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676538062673 type: FLUSH version: 2 ttl: 0 2023-02-16 09:01:03,421 DEBUG [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839/data/default/testWithMapReduce 2023-02-16 09:01:03,421 INFO [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(239): region to add: 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:03,421 INFO [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(585): clone region=0b91c545861488c85762f2341ad54518 as 0b91c545861488c85762f2341ad54518 in snapshot testWithMapReduceSingleRegion 2023-02-16 09:01:03,422 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0b91c545861488c85762f2341ad54518, NAME => 'testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839 2023-02-16 09:01:03,433 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:03,433 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7079e1502ed7445aa60b6bad8c5d2dc3 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 09:01:03,435 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 03b1a070d44e400686f8c29f64433015 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 09:01:03,436 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0b91c545861488c85762f2341ad54518, disabling compactions & flushes 2023-02-16 09:01:03,436 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,436 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,436 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. after waiting 0 ms 2023-02-16 09:01:03,436 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,436 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:03,436 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:03,437 INFO [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676538062673 type: FLUSH version: 2 ttl: 0 2023-02-16 09:01:03,437 DEBUG [Listener at localhost/39023] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839 2023-02-16 09:01:03,437 DEBUG [Listener at localhost/39023] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839 2023-02-16 09:01:03,437 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |-data/ 2023-02-16 09:01:03,437 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |----default/ 2023-02-16 09:01:03,438 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 09:01:03,438 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |----------0b91c545861488c85762f2341ad54518/ 2023-02-16 09:01:03,438 DEBUG [Listener at localhost/39023] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 09:01:03,438 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 09:01:03,439 DEBUG [Listener at localhost/39023] util.CommonFSUtils(702): |----------------testWithMapReduce=0b91c545861488c85762f2341ad54518-7079e1502ed7445aa60b6bad8c5d2dc3 2023-02-16 09:01:03,439 DEBUG [Listener at localhost/39023] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 09:01:03,439 DEBUG [Listener at localhost/39023] util.CommonFSUtils(702): |----------------testWithMapReduce=0b91c545861488c85762f2341ad54518-03b1a070d44e400686f8c29f64433015 2023-02-16 09:01:03,439 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:03,440 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:03,440 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:03,440 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,377 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop-242553681836559184.jar 2023-02-16 09:01:04,377 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,378 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,444 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop-8855890822618188768.jar 2023-02-16 09:01:04,444 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,445 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,445 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,445 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,446 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,446 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,446 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 09:01:04,447 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 09:01:04,447 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 09:01:04,447 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 09:01:04,448 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 09:01:04,448 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 09:01:04,448 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 09:01:04,449 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 09:01:04,449 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 09:01:04,450 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 09:01:04,450 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 09:01:04,451 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:01:04,451 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:01:04,451 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 09:01:04,452 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:01:04,522 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/hadoop-8363357578941750974.jar 2023-02-16 09:01:04,522 DEBUG [Listener at localhost/39023] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 09:01:04,529 WARN [Listener at localhost/39023] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 09:01:04,537 WARN [Listener at localhost/39023] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 09:01:04,543 INFO [Listener at localhost/39023] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 09:01:04,661 WARN [Listener at localhost/39023] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/mapreduce.cluster.local.dir/1676538064594/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 09:01:04,661 WARN [Listener at localhost/39023] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/mapreduce.cluster.local.dir/1676538064594/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 09:01:04,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 09:01:04,696 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 09:01:04,696 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 09:01:04,698 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:04,698 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1 2023-02-16 09:01:04,699 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b91c545861488c85762f2341ad54518 columnFamilyName f1 2023-02-16 09:01:04,702 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(539): loaded hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/testWithMapReduce=0b91c545861488c85762f2341ad54518-7079e1502ed7445aa60b6bad8c5d2dc3 2023-02-16 09:01:04,702 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(310): Store=0b91c545861488c85762f2341ad54518/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:04,703 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:04,703 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2 2023-02-16 09:01:04,703 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b91c545861488c85762f2341ad54518 columnFamilyName f2 2023-02-16 09:01:04,707 DEBUG [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(539): loaded hdfs://localhost:38759/user/jenkins/test-data/0693ee95-0497-d8c0-59d1-1753cb907179/testWithMapReduceSingleRegion/62d0ba79-c5e1-44bc-9582-bb18cb338839/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/testWithMapReduce=0b91c545861488c85762f2341ad54518-03b1a070d44e400686f8c29f64433015 2023-02-16 09:01:04,707 INFO [StoreOpener-0b91c545861488c85762f2341ad54518-1] regionserver.HStore(310): Store=0b91c545861488c85762f2341ad54518/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 09:01:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 09:01:04,707 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0b91c545861488c85762f2341ad54518; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71986366, jitterRate=0.07268044352531433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 09:01:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:04,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0b91c545861488c85762f2341ad54518, disabling compactions & flushes 2023-02-16 09:01:04,784 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:04,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:04,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. after waiting 0 ms 2023-02-16 09:01:04,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:04,785 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:04,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:05,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-16 09:01:05,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-16 09:01:05,701 INFO [Listener at localhost/39023] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 09:01:05,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 09:01:05,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 09:01:05,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:01:05,705 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538065705"}]},"ts":"1676538065705"} 2023-02-16 09:01:05,706 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 09:01:05,707 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 09:01:05,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, UNASSIGN}] 2023-02-16 09:01:05,708 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, UNASSIGN 2023-02-16 09:01:05,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0b91c545861488c85762f2341ad54518, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:05,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676538065709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676538065709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676538065709"}]},"ts":"1676538065709"} 2023-02-16 09:01:05,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 0b91c545861488c85762f2341ad54518, server=jenkins-hbase4.apache.org,33883,1676538060898}] 2023-02-16 09:01:05,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:01:05,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:05,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0b91c545861488c85762f2341ad54518, disabling compactions & flushes 2023-02-16 09:01:05,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:05,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:05,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. after waiting 0 ms 2023-02-16 09:01:05,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:05,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 09:01:05,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518. 2023-02-16 09:01:05,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0b91c545861488c85762f2341ad54518: 2023-02-16 09:01:05,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0b91c545861488c85762f2341ad54518 2023-02-16 09:01:05,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0b91c545861488c85762f2341ad54518, regionState=CLOSED 2023-02-16 09:01:05,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676538065868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676538065868"}]},"ts":"1676538065868"} 2023-02-16 09:01:05,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 09:01:05,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 0b91c545861488c85762f2341ad54518, server=jenkins-hbase4.apache.org,33883,1676538060898 in 159 msec 2023-02-16 09:01:05,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 09:01:05,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0b91c545861488c85762f2341ad54518, UNASSIGN in 162 msec 2023-02-16 09:01:05,871 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676538065871"}]},"ts":"1676538065871"} 2023-02-16 09:01:05,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 09:01:05,873 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 09:01:05,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 172 msec 2023-02-16 09:01:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 09:01:06,007 INFO [Listener at localhost/39023] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-16 09:01:06,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 09:01:06,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,011 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:01:06,014 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:06,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1, FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2, FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/recovered.edits] 2023-02-16 09:01:06,018 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/6f050d21de4b4583b5a7b7f5082ffe68 to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/archive/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/6f050d21de4b4583b5a7b7f5082ffe68 2023-02-16 09:01:06,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3 to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/archive/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f1/7079e1502ed7445aa60b6bad8c5d2dc3 2023-02-16 09:01:06,022 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015 to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/archive/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/03b1a070d44e400686f8c29f64433015 2023-02-16 09:01:06,023 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/90a268616bc9402ba37417ef8ee690c4 to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/archive/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/f2/90a268616bc9402ba37417ef8ee690c4 2023-02-16 09:01:06,025 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/recovered.edits/12.seqid to hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/archive/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518/recovered.edits/12.seqid 2023-02-16 09:01:06,026 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/.tmp/data/default/testWithMapReduce/0b91c545861488c85762f2341ad54518 2023-02-16 09:01:06,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 09:01:06,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,030 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-16 09:01:06,032 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 09:01:06,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 09:01:06,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676538066033"}]},"ts":"9223372036854775807"} 2023-02-16 09:01:06,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 09:01:06,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b91c545861488c85762f2341ad54518, NAME => 'testWithMapReduce,,1676538061924.0b91c545861488c85762f2341ad54518.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 09:01:06,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 09:01:06,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676538066034"}]},"ts":"9223372036854775807"} 2023-02-16 09:01:06,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 09:01:06,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 09:01:06,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 31 msec 2023-02-16 09:01:06,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 09:01:06,113 INFO [Listener at localhost/39023] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-16 09:01:06,113 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 09:01:06,113 INFO [Listener at localhost/39023] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 09:01:06,113 DEBUG [Listener at localhost/39023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13bc40cc to 127.0.0.1:60420 2023-02-16 09:01:06,113 DEBUG [Listener at localhost/39023] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,113 DEBUG [Listener at localhost/39023] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 09:01:06,113 DEBUG [Listener at localhost/39023] util.JVMClusterUtil(257): Found active master hash=1796291007, stopped=false 2023-02-16 09:01:06,113 INFO [Listener at localhost/39023] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:06,115 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:06,115 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:06,115 INFO [Listener at localhost/39023] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 09:01:06,115 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 09:01:06,115 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:06,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:06,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:06,117 DEBUG [Listener at localhost/39023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e6dd230 to 127.0.0.1:60420 2023-02-16 09:01:06,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 09:01:06,117 DEBUG [Listener at localhost/39023] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,117 INFO [Listener at localhost/39023] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44913,1676538060878' ***** 2023-02-16 09:01:06,117 INFO [Listener at localhost/39023] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:01:06,117 INFO [Listener at localhost/39023] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33883,1676538060898' ***** 2023-02-16 09:01:06,117 INFO [Listener at localhost/39023] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 09:01:06,118 INFO [RS:0;jenkins-hbase4:44913] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:01:06,118 INFO [RS:1;jenkins-hbase4:33883] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 09:01:06,118 INFO [RS:0;jenkins-hbase4:44913] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:01:06,118 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:01:06,118 INFO [RS:0;jenkins-hbase4:44913] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:01:06,118 INFO [RS:1;jenkins-hbase4:33883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 09:01:06,119 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(3304): Received CLOSE for f523b398762121a5d783d15a3d785675 2023-02-16 09:01:06,118 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 09:01:06,119 INFO [RS:1;jenkins-hbase4:33883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 09:01:06,119 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:06,120 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:06,120 DEBUG [RS:0;jenkins-hbase4:44913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x071cf988 to 127.0.0.1:60420 2023-02-16 09:01:06,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f523b398762121a5d783d15a3d785675, disabling compactions & flushes 2023-02-16 09:01:06,120 DEBUG [RS:0;jenkins-hbase4:44913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:06,121 INFO [RS:0;jenkins-hbase4:44913] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:01:06,121 INFO [RS:0;jenkins-hbase4:44913] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:01:06,121 INFO [RS:0;jenkins-hbase4:44913] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:01:06,120 DEBUG [RS:1;jenkins-hbase4:33883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16e3b44b to 127.0.0.1:60420 2023-02-16 09:01:06,121 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 09:01:06,121 DEBUG [RS:1;jenkins-hbase4:33883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:06,121 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33883,1676538060898; all regions closed. 2023-02-16 09:01:06,121 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. after waiting 0 ms 2023-02-16 09:01:06,121 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1479): Online Regions={f523b398762121a5d783d15a3d785675=hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:06,121 DEBUG [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1505): Waiting on 1588230740, f523b398762121a5d783d15a3d785675 2023-02-16 09:01:06,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 09:01:06,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f523b398762121a5d783d15a3d785675 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 09:01:06,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 09:01:06,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-16 09:01:06,128 DEBUG [RS:1;jenkins-hbase4:33883] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33883%2C1676538060898:(num 1676538062204) 2023-02-16 09:01:06,128 DEBUG [RS:1;jenkins-hbase4:33883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 09:01:06,128 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 09:01:06,128 INFO [RS:1;jenkins-hbase4:33883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 09:01:06,129 INFO [RS:1;jenkins-hbase4:33883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33883 2023-02-16 09:01:06,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/info/f2be04769b734555bf810731e6c1d81c 2023-02-16 09:01:06,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/.tmp/info/fc68cb2ef224432eaaa4bd6f9e88a4ff 2023-02-16 09:01:06,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2be04769b734555bf810731e6c1d81c 2023-02-16 09:01:06,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/.tmp/info/fc68cb2ef224432eaaa4bd6f9e88a4ff as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/info/fc68cb2ef224432eaaa4bd6f9e88a4ff 2023-02-16 09:01:06,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/info/fc68cb2ef224432eaaa4bd6f9e88a4ff, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 09:01:06,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f523b398762121a5d783d15a3d785675 in 25ms, sequenceid=6, compaction requested=false 2023-02-16 09:01:06,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/namespace/f523b398762121a5d783d15a3d785675/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 09:01:06,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/rep_barrier/c80198b49370496a8d55f52ab9c05540 2023-02-16 09:01:06,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:06,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f523b398762121a5d783d15a3d785675: 2023-02-16 09:01:06,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676538061410.f523b398762121a5d783d15a3d785675. 2023-02-16 09:01:06,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c80198b49370496a8d55f52ab9c05540 2023-02-16 09:01:06,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/table/22221db585e0486e8d0ca404a30778d9 2023-02-16 09:01:06,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22221db585e0486e8d0ca404a30778d9 2023-02-16 09:01:06,165 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/info/f2be04769b734555bf810731e6c1d81c as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/info/f2be04769b734555bf810731e6c1d81c 2023-02-16 09:01:06,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2be04769b734555bf810731e6c1d81c 2023-02-16 09:01:06,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/info/f2be04769b734555bf810731e6c1d81c, entries=12, sequenceid=21, filesize=6.2 K 2023-02-16 09:01:06,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/rep_barrier/c80198b49370496a8d55f52ab9c05540 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/rep_barrier/c80198b49370496a8d55f52ab9c05540 2023-02-16 09:01:06,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c80198b49370496a8d55f52ab9c05540 2023-02-16 09:01:06,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/rep_barrier/c80198b49370496a8d55f52ab9c05540, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 09:01:06,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/.tmp/table/22221db585e0486e8d0ca404a30778d9 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/table/22221db585e0486e8d0ca404a30778d9 2023-02-16 09:01:06,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22221db585e0486e8d0ca404a30778d9 2023-02-16 09:01:06,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/table/22221db585e0486e8d0ca404a30778d9, entries=4, sequenceid=21, filesize=5.0 K 2023-02-16 09:01:06,176 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 09:01:06,176 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 09:01:06,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-16 09:01:06,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 09:01:06,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 09:01:06,182 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:01:06,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 09:01:06,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 09:01:06,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 09:01:06,183 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:01:06,224 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:06,224 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:01:06,224 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33883,1676538060898 2023-02-16 09:01:06,224 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:01:06,224 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cc5c8ff rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,224 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:01:06,224 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e5f31f8 rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,225 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33883,1676538060898] 2023-02-16 09:01:06,225 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33883,1676538060898; numProcessing=1 2023-02-16 09:01:06,227 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33883,1676538060898 already deleted, retry=false 2023-02-16 09:01:06,227 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33883,1676538060898 expired; onlineServers=1 2023-02-16 09:01:06,321 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44913,1676538060878; all regions closed. 2023-02-16 09:01:06,325 DEBUG [RS:0;jenkins-hbase4:44913] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs 2023-02-16 09:01:06,325 INFO [RS:0;jenkins-hbase4:44913] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44913%2C1676538060878.meta:.meta(num 1676538061356) 2023-02-16 09:01:06,328 DEBUG [RS:0;jenkins-hbase4:44913] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/oldWALs 2023-02-16 09:01:06,328 INFO [RS:0;jenkins-hbase4:44913] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44913%2C1676538060878:(num 1676538061752) 2023-02-16 09:01:06,328 DEBUG [RS:0;jenkins-hbase4:44913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,328 INFO [RS:0;jenkins-hbase4:44913] regionserver.LeaseManager(133): Closed leases 2023-02-16 09:01:06,328 INFO [RS:0;jenkins-hbase4:44913] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 09:01:06,328 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:01:06,331 INFO [RS:0;jenkins-hbase4:44913] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44913 2023-02-16 09:01:06,332 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44913,1676538060878 2023-02-16 09:01:06,332 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 09:01:06,332 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@722d7038 rejected from java.util.concurrent.ThreadPoolExecutor@7612faa5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,333 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44913,1676538060878] 2023-02-16 09:01:06,333 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44913,1676538060878; numProcessing=2 2023-02-16 09:01:06,334 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44913,1676538060878 already deleted, retry=false 2023-02-16 09:01:06,334 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44913,1676538060878 expired; onlineServers=0 2023-02-16 09:01:06,334 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38675,1676538060837' ***** 2023-02-16 09:01:06,334 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 09:01:06,335 DEBUG [M:0;jenkins-hbase4:38675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f2ea005, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 09:01:06,335 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38675,1676538060837 2023-02-16 09:01:06,335 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38675,1676538060837; all regions closed. 2023-02-16 09:01:06,335 DEBUG [M:0;jenkins-hbase4:38675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 09:01:06,335 DEBUG [M:0;jenkins-hbase4:38675] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 09:01:06,335 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 09:01:06,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538061016] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676538061016,5,FailOnTimeoutGroup] 2023-02-16 09:01:06,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538061016] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676538061016,5,FailOnTimeoutGroup] 2023-02-16 09:01:06,335 DEBUG [M:0;jenkins-hbase4:38675] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 09:01:06,337 INFO [M:0;jenkins-hbase4:38675] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 09:01:06,337 INFO [M:0;jenkins-hbase4:38675] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 09:01:06,337 INFO [M:0;jenkins-hbase4:38675] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 09:01:06,337 DEBUG [M:0;jenkins-hbase4:38675] master.HMaster(1512): Stopping service threads 2023-02-16 09:01:06,337 INFO [M:0;jenkins-hbase4:38675] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 09:01:06,338 ERROR [M:0;jenkins-hbase4:38675] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 09:01:06,338 INFO [M:0;jenkins-hbase4:38675] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 09:01:06,338 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 09:01:06,338 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 09:01:06,338 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 09:01:06,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 09:01:06,338 DEBUG [M:0;jenkins-hbase4:38675] zookeeper.ZKUtil(398): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 09:01:06,338 WARN [M:0;jenkins-hbase4:38675] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 09:01:06,338 INFO [M:0;jenkins-hbase4:38675] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 09:01:06,339 INFO [M:0;jenkins-hbase4:38675] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 09:01:06,339 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 09:01:06,339 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:06,339 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:06,339 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 09:01:06,339 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:06,339 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.66 KB heapSize=65.63 KB 2023-02-16 09:01:06,346 INFO [M:0;jenkins-hbase4:38675] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/594ddf9a37244360ba4c87c5625a8323 2023-02-16 09:01:06,350 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/594ddf9a37244360ba4c87c5625a8323 as hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/594ddf9a37244360ba4c87c5625a8323 2023-02-16 09:01:06,354 INFO [M:0;jenkins-hbase4:38675] regionserver.HStore(1080): Added hdfs://localhost:38759/user/jenkins/test-data/30a91a22-ebf3-a239-7111-ab68bc32ce72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/594ddf9a37244360ba4c87c5625a8323, entries=17, sequenceid=132, filesize=8.6 K 2023-02-16 09:01:06,354 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegion(2947): Finished flush of dataSize ~54.66 KB/55975, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-16 09:01:06,355 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 09:01:06,355 DEBUG [M:0;jenkins-hbase4:38675] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 09:01:06,356 INFO [M:0;jenkins-hbase4:38675] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 09:01:06,356 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 09:01:06,357 INFO [M:0;jenkins-hbase4:38675] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38675 2023-02-16 09:01:06,358 DEBUG [M:0;jenkins-hbase4:38675] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38675,1676538060837 already deleted, retry=false 2023-02-16 09:01:06,515 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,515 INFO [M:0;jenkins-hbase4:38675] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38675,1676538060837; zookeeper connection closed. 2023-02-16 09:01:06,515 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ea0494b rejected from java.util.concurrent.ThreadPoolExecutor@2a9fc847[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,517 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): master:38675-0x1005c5c89d80000, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,517 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@727e2baf rejected from java.util.concurrent.ThreadPoolExecutor@2a9fc847[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,615 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,615 INFO [RS:0;jenkins-hbase4:44913] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44913,1676538060878; zookeeper connection closed. 2023-02-16 09:01:06,616 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bdc218d rejected from java.util.concurrent.ThreadPoolExecutor@7612faa5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,616 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:44913-0x1005c5c89d80001, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,616 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@634f2b44 rejected from java.util.concurrent.ThreadPoolExecutor@7612faa5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,616 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18acb06b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18acb06b 2023-02-16 09:01:06,716 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,716 INFO [RS:1;jenkins-hbase4:33883] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33883,1676538060898; zookeeper connection closed. 2023-02-16 09:01:06,716 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26223569 rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,716 DEBUG [Listener at localhost/39023-EventThread] zookeeper.ZKWatcher(600): regionserver:33883-0x1005c5c89d80002, quorum=127.0.0.1:60420, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 09:01:06,716 ERROR [Listener at localhost/39023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a201b38 rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 09:01:06,716 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d379b7d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d379b7d 2023-02-16 09:01:06,716 INFO [Listener at localhost/39023] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 09:01:06,717 WARN [Listener at localhost/39023] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:01:06,720 INFO [Listener at localhost/39023] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:01:06,726 WARN [BP-2042023257-172.31.14.131-1676538060100 heartbeating to localhost/127.0.0.1:38759] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:01:06,726 WARN [BP-2042023257-172.31.14.131-1676538060100 heartbeating to localhost/127.0.0.1:38759] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2042023257-172.31.14.131-1676538060100 (Datanode Uuid dc39ae52-0ff9-40ca-910a-74ed6a32d82a) service to localhost/127.0.0.1:38759 2023-02-16 09:01:06,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/dfs/data/data3/current/BP-2042023257-172.31.14.131-1676538060100] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:01:06,727 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/dfs/data/data4/current/BP-2042023257-172.31.14.131-1676538060100] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:01:06,728 WARN [Listener at localhost/39023] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 09:01:06,731 INFO [Listener at localhost/39023] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:01:06,832 WARN [BP-2042023257-172.31.14.131-1676538060100 heartbeating to localhost/127.0.0.1:38759] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 09:01:06,832 WARN [BP-2042023257-172.31.14.131-1676538060100 heartbeating to localhost/127.0.0.1:38759] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2042023257-172.31.14.131-1676538060100 (Datanode Uuid 6e073fac-8cda-4d9d-8917-bc964233d194) service to localhost/127.0.0.1:38759 2023-02-16 09:01:06,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/dfs/data/data1/current/BP-2042023257-172.31.14.131-1676538060100] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:01:06,833 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c2942d3c-54ec-83a3-2915-9f123c91216f/cluster_c3e1f50e-b2ec-44ce-0ef4-418b7173ea4d/dfs/data/data2/current/BP-2042023257-172.31.14.131-1676538060100] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 09:01:06,844 INFO [Listener at localhost/39023] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 09:01:06,876 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 09:01:06,975 INFO [Listener at localhost/39023] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 09:01:06,991 INFO [Listener at localhost/39023] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 09:01:07,006 INFO [Listener at localhost/39023] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 274) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38759 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39023 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38759 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38759 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:38759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38675,1676538060837)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:38759 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:38759 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 274), ProcessCount=168 (was 170), AvailableMemoryMB=2352 (was 1414) - AvailableMemoryMB LEAK? -